00000001:02000400:1.0F:1787383040.383221:0:2966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787383057.037448:0:3188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787383058.783430:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 915 MB/s 00000001:01000000:2.0:1787383059.032958:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1295 MB/s 00000001:01000000:3.0F:1787383059.282949:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5451 MB/s 00000020:02000000:2.0:1787383059.925840:0:3281:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_114_g76b937b 00000400:02000000:3.0:1787383060.869283:0:3296:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.119@tcp [8/256/0/180] 00008000:02000000:3.0:1787383064.220366:0:3445:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1787383111.075758:0:5251:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787383119.660263:0:5784:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383119.660268:0:5784:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787383119.660375:0:5784:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004227a190 00000080:02000400:1.0:1787383119.660384:0:5784:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787383119.662833:0:5784:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787383119.662850:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787383119.662911:0:5784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000056927f78) 00000020:00000080:1.0:1787383119.662935:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787383119.674199:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787383119.674615:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787383119.691495:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787383119.691531:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787383119.691549:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787383119.691596:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787383119.691618:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787383119.692031:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787383119.692040:0:5784:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383119.692051:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce768 00000020:01000004:1.0:1787383119.692059:0:5784:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787383119.692064:0:5784:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787383119.692069:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004227a190 from MGS 00000020:01000004:1.0:1787383119.692073:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787383119.692083:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004dd5b3bc) 00000020:00000080:1.0:1787383119.692093:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787383119.692146:0:5784:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004227a190 from MGS, refs=2 00080000:01000000:1.0:1787383119.692151:0:5784:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383119.692156:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce776 00000100:00100000:1.0:1787383119.692252:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787383119.692392:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787383119.692399:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787383119.693029:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787383119.693037:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787383119.693675:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383119.693818:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787383119.693822:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787383119.694386:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787383119.694393:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787383119.694637:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787383119.694644:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787383119.695362:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383119.695366:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383119.695368:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383119.695689:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383119.695691:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383119.695693:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383119.696229:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787383119.702009:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787383119.946321:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3655 MB/s 00000001:01000000:2.0:1787383120.196097:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2763 MB/s 00000001:01000000:0.0:1787383120.446733:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 691 MB/s 00000001:01000000:1.0:1787383120.696502:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 619 MB/s 00080000:10000000:1.0:1787383120.705754:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787383120.714037:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787383120.730146:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787383120.730178:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787383120.730181:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787383120.735594:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787383120.736551:0:5784:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787383120.736616:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787383120.738196:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787383120.738239:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787383120.739692:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383120.739863:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787383120.742931:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787383120.744294:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787383120.744313:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787383120.746815:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787383120.746828:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787383120.747996:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787383120.748022:0:5784:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:1.0:1787383120.748024:0:5784:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1787383120.748032:0:5799:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1787383120.748073:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:1.0:1787383120.748085:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (00000000e2be0833) 00000020:00000080:1.0:1787383120.748104:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787383120.748180:0:5784:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002579e19f@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1787383120.748346:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:1.0:1787383120.748352:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787383120.750950:0:5800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787383120.756724:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid f5c45d0c-8d4a-4848-86e1-7f0dbcd24267) 00000020:00000080:0.0:1787383120.756835:0:5784:0:(genops.c:1406:class_connect()) connect: client f5c45d0c-8d4a-4848-86e1-7f0dbcd24267, cookie 0x42020b050d5ce784 00000100:00080000:0.0:1787383120.756847:0:5784:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383120.756852:0:5784:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import 000000002579e19f using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383120.756908:0:5784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de8dc841 x1874206979522688/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383120.756931:0:5784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS 00000020:01000004:0.0:1787383120.756950:0:5784:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787383120.756970:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787383120.756988:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000055bd47) 00000020:00000080:0.0:1787383120.757001:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787383120.757655:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000de8dc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979522688:0@lo:250: 00000100:00100000:2.0:1787383120.757727:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383120.757768:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979522688 00000100:00100000:3.0:1787383120.757776:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979522688 00000100:00100000:3.0:1787383120.757815:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383120.757821:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c81ff92a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1874206979522688:12345-0@lo:250: 00010000:00080000:3.0:1787383120.757847:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f5c45d0c-8d4a-4848-86e1-7f0dbcd24267@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1787383120.757895:0:5796:0:(genops.c:1406:class_connect()) connect: client f5c45d0c-8d4a-4848-86e1-7f0dbcd24267, cookie 0x42020b050d5ce792 00000100:00080000:3.0:1787383120.758019:0:5796:0:(import.c:65:import_set_state_nolock()) 0000000086125403 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383120.758089:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c81ff92a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:3311:x1874206979522688:12345-0@lo:250: Request processed in 265us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383120.758098:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383120.758148:0:3311:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787383120.758157:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:3.0:1787383120.758165:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787383120.758170:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787383120.758173:0:3311:0:(import.c:65:import_set_state_nolock()) 000000002579e19f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787383120.758176:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787383120.758240:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787383120.758247:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000de8dc841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979522688:0@lo:250: 00000100:00100000:0.0:1787383120.776502:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383120.776763:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383120.776770:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787383120.778439:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787383120.778451:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787383120.779212:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787383120.779220:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787383120.780319:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383120.780478:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787383120.780488:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787383120.782243:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787383120.782251:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787383120.814347:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383120.814564:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787383120.814571:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787383120.815895:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787383120.815906:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787383120.816606:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383120.816758:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787383120.816764:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787383120.817516:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383120.817524:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787383120.818224:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383120.818460:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787383120.818465:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787383120.819129:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383120.819136:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787383120.820025:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383120.820183:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787383120.820189:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787383120.822844:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383120.822857:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787383120.847281:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383120.847571:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383120.847579:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787383120.850108:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787383120.850124:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787383120.850811:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787383120.850828:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787383120.853185:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787383120.853220:0:5784:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787383120.853226:0:5784:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787383120.853465:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787383120.853510:0:5784:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787383120.853516:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787383120.853517:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787383120.853519:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383120.853520:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383120.853521:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383120.853523:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383120.853524:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383120.853525:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787383120.853527:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383120.853528:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383120.853530:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383120.853532:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383120.853535:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787383120.853537:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383120.853538:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787383120.853540:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383120.853541:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383120.853542:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383120.853543:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383120.853544:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383120.853545:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787383120.853546:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383120.853547:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383120.853548:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383120.853550:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383120.853578:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787383120.853597:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000716d1c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979522816:0@lo:253: 00000100:00100000:0.0:1787383120.853675:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383120.853762:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf5e2048 going to sleep for 11 seconds 00000100:00100000:2.0:1787383120.853829:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979522816 00000100:00100000:2.0:1787383120.853838:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979522816 00000100:00100000:2.0:1787383120.854148:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383120.854157:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7033301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5784:x1874206979522816:12345-0@lo:253: 20000000:01000000:2.0:1787383120.854203:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787383120.854207:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787383120.854622:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787383120.854686:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787383120.855254:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383120.856426:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787383120.856646:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787383120.856650:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787383120.856655:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787383120.856658:0:5798:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787383120.856670:0:5798:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787383120.856930:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383120.857147:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787383120.857162:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787383120.857211:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787383120.857243:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787383120.857291:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787383120.857371:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787383120.857380:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787383120.857426:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787383120.857434:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787383120.857455:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787383120.857459:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787383120.857474:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787383120.857512:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787383120.857533:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787383120.857537:0:5798:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787383120.857551:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383120.857676:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787383120.857683:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787383120.857703:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787383120.857720:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787383120.857744:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787383120.857751:0:5798:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787383120.857793:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787383120.857801:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787383120.857824:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787383120.857843:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787383120.857859:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787383120.857909:0:5798:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787383120.857997:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787383120.858007:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787383120.858039:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787383120.858090:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787383120.858254:0:5798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787383120.858292:0:5798:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787383120.858311:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787383120.860682:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787383120.861236:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787383120.861267:0:5798:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.119@tcp for mdt 20000000:01000000:2.0:1787383120.861270:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:2.0:1787383120.861319:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787383120.861328:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787383120.861371:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787383120.861379:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:2.0:1787383120.861426:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787383120.861436:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787383120.861471:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787383120.861504:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787383120.861565:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787383120.861568:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787383120.861574:0:5798:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787383120.861581:0:5798:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787383120.865524:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787383120.865678:0:5798:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787383120.869185:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787383120.869225:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787383120.876139:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787383120.876178:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787383120.876180:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787383120.876183:0:5798:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787383120.876197:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787383120.876199:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787383120.876236:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787383120.876238:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787383120.876949:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787383120.877425:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787383120.877455:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787383120.877473:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787383120.877480:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787383120.877482:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787383120.877799:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787383120.878100:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787383120.878130:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787383120.878163:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1787383120.878174:0:5798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383120.878175:0:5798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787383120.878181:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787383120.878196:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878209:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878216:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878220:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878223:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878227:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878231:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000000cf188d already unused, calling callback (00000000806c3757) 00010000:00010000:3.0:1787383120.878233:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878237:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878246:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878256:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383120.878259:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000cf188d/0x42020b050d5ce799 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383120.878274:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787383121.115226:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7033301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5784:x1874206979522816:12345-0@lo:253: Request processed in 261062us (261543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.115262:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383121.115539:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000716d1c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979522816:0@lo:253: 10000000:01000000:3.0:1787383121.115554:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787383121.115558:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383121.115560:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383121.115561:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383121.115563:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787383121.115564:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383121.115565:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383121.115566:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383121.115568:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383121.115569:0:5784:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787383121.115571:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383121.115572:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787383121.115590:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004227a190 from lustre-MDT0000 10000000:01000000:3.0:1787383121.115613:0:5784:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787383121.115615:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787383121.115618:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ffc173ecd40 10000000:01000000:3.0:1787383121.115622:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383121.115627:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffc173ecd40 from 1 10000000:01000000:3.0:1787383121.115629:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787383121.115671:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.115680:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.115693:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383121.115706:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008f4c4fe0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979522944:0@lo:101: 00000100:00100000:3.0:1787383121.115734:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383121.115781:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979522944 00000100:00100000:0.0:1787383121.115788:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979522944 00000100:00100000:3.0:1787383121.115790:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012cdc66b going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.115919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383121.115928:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074ec4991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5784:x1874206979522944:12345-0@lo:101: 00010000:00010000:0.0:1787383121.115943:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383121.115956:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce7a0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.115978:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.115987:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.115996:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c913875d, rc 0) 00000100:00100000:0.0:1787383121.116077:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074ec4991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+6:5784:x1874206979522944:12345-0@lo:101: Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.116084:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383121.116123:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008f4c4fe0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979522944:0@lo:101: 00010000:00010000:1.0:1787383121.116135:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.116143:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.116205:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523072:0@lo:501: 00000100:00100000:1.0:1787383121.116230:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.118227:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e7544d1 going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.127435:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523072 00000100:00100000:3.0:1787383121.127450:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523072 00000100:00100000:3.0:1787383121.127509:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383121.127518:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caaef3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+6:5784:x1874206979523072:12345-0@lo:501: 00000100:00100000:3.0:1787383121.127848:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caaef3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+6:5784:x1874206979523072:12345-0@lo:501: Request processed in 330us (11616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383121.127857:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383121.127909:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523072:0@lo:501: 10000000:01000000:1.0:1787383121.127945:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787383121.127965:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.127975:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383121.127983:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffc2750b800 10000000:01000000:1.0:1787383121.127988:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383121.127992:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ffc2750b800 10000000:01000000:1.0:1787383121.127995:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787383121.127997:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ffc2750b800 from 1 10000000:01000000:1.0:1787383121.128000:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787383121.128032:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128039:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128047:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.128065:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523200:0@lo:101: 00000100:00100000:1.0:1787383121.128111:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.128148:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e7544d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.128208:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523200 00000100:00100000:0.0:1787383121.128213:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523200 00000100:00100000:0.0:1787383121.128235:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383121.128241:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea9d0584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+7:5784:x1874206979523200:12345-0@lo:101: 00010000:00010000:0.0:1787383121.128249:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383121.128262:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005eb6010d/0x42020b050d5ce7b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce7ae expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.128282:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005eb6010d/0x42020b050d5ce7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce7ae expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.128313:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005eb6010d/0x42020b050d5ce7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce7ae expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.128322:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005eb6010d, rc 0) 00000100:00100000:0.0:1787383121.128434:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea9d0584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:5784:x1874206979523200:12345-0@lo:101: Request processed in 193us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.128441:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383121.128564:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523200:0@lo:101: 00010000:00010000:1.0:1787383121.128574:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128582:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383121.128593:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787383121.128606:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128612:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000b7515e65/0x42020b050d5ce7ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383121.128618:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787383121.128622:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383121.128626:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ffc2750b800 10000000:01000000:1.0:1787383121.128628:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787383121.128631:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787383121.128632:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383121.128643:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128650:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.128656:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.128674:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523328:0@lo:101: 00000100:00100000:1.0:1787383121.128698:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.128784:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e7544d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.129221:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523328 00000100:00100000:0.0:1787383121.129227:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523328 00000100:00100000:2.0:1787383121.129458:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383121.129467:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056aaa1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:5784:x1874206979523328:12345-0@lo:101: 00010000:00010000:2.0:1787383121.129478:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383121.129492:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce7bc expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383121.129512:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383121.129529:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383121.129537:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007008655, rc 0) 00000100:00100000:2.0:1787383121.129582:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056aaa1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5784:x1874206979523328:12345-0@lo:101: Request processed in 117us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383121.129588:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383121.129662:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523328:0@lo:101: 00010000:00010000:1.0:1787383121.129675:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.129683:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.129730:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523456:0@lo:501: 00000100:00100000:1.0:1787383121.129757:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.129841:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e7544d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.129916:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523456 00000100:00100000:0.0:1787383121.129921:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523456 00000100:00100000:0.0:1787383121.129941:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383121.129946:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d1982f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5784:x1874206979523456:12345-0@lo:501: 00000100:00100000:0.0:1787383121.130202:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d1982f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979523456:12345-0@lo:501: Request processed in 255us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.130210:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383121.130286:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523456:0@lo:501: 00000100:00100000:1.0:1787383121.130323:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523584:0@lo:503: 00000100:00100000:1.0:1787383121.130424:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.130448:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e7544d1 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.130498:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523584 00000100:00100000:0.0:1787383121.130502:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523584 00000100:00100000:0.0:1787383121.130519:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383121.130524:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfbe236b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979523584:12345-0@lo:503: 00000100:00100000:0.0:1787383121.130722:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfbe236b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979523584:12345-0@lo:503: Request processed in 198us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.130729:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383121.130825:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523584:0@lo:503: 00000100:00100000:2.0:1787383121.131457:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098f84d97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5827:1874206979523712:0@lo:502: 00000100:00100000:2.0:1787383121.131501:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383121.131575:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set 00000000955f89b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.131615:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523712 00000100:00100000:0.0:1787383121.131620:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523712 00000100:00100000:0.0:1787383121.131694:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383121.131701:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e98b4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5827:x1874206979523712:12345-0@lo:502: 00000100:00100000:0.0:1787383121.131912:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e98b4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5827:x1874206979523712:12345-0@lo:502: Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.131920:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383121.131998:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098f84d97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5827:1874206979523712:0@lo:502: 00000020:01000000:2.0:1787383121.132024:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383121.132036:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383121.132039:0:5827:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787383121.132046:0:5827:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787383121.132049:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383121.132075:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000020c82863) 00000020:00000080:2.0:1787383121.132096:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787383121.132103:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787383121.132171:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787383121.132190:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce7d1 00000020:00000080:2.0:1787383121.132462:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787383121.132468:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383121.132472:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383121.132473:0:5827:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787383121.132476:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383121.132479:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383121.132481:0:5827:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787383121.132491:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383121.132498:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bb2496c0) 00000020:00000080:2.0:1787383121.132508:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787383121.132512:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787383121.132514:0:5827:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787383121.132517:0:5827:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787383121.132522:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383121.132569:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004227a190 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787383121.132581:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003e7aa14e) 00000020:00000080:2.0:1787383121.132588:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787383121.132646:0:5827:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787383121.132652:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5ce7e6 00000020:00000080:2.0:1787383121.132778:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787383121.132785:0:5827:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787383121.132789:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42020b050d5ce7ed 00080000:01000000:2.0:1787383121.132794:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787383121.132797:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce7f4 00080000:10000000:2.0:1787383121.133255:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787383121.133484:0:5827:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787383121.138041:0:5827:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787383121.207104:0:5827:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787383121.208766:0:5827:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787383121.211663:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787383121.212064:0:5827:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787383121.238188:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000905776cf) 00000020:00000080:1.0:1787383121.238222:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787383121.238307:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787383121.238315:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce802 00000020:00000080:0.0:1787383121.242074:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787383121.243529:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383121.283514:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383121.317614:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383121.345811:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383121.384238:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.419342:0:5827:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787383121.439514:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42020b050d5ce809 00000020:00000080:1.0:1787383121.440140:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787383121.440158:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383121.440164:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383121.440166:0:5827:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787383121.440170:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383121.440175:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383121.440177:0:5827:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787383121.440181:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787383121.440219:0:5827:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787383121.440233:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383121.440237:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383121.440238:0:5827:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787383121.440240:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383121.440243:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383121.440244:0:5827:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383121.440247:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383121.440249:0:5827:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787383121.440308:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5827:1874206979523840:0@lo:502: 00000100:00100000:1.0:1787383121.440394:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.440465:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005afae06 going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.440533:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523840 00000100:00100000:3.0:1787383121.440541:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523840 00000100:00100000:3.0:1787383121.440587:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383121.440596:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096c55d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5827:x1874206979523840:12345-0@lo:502: 00000100:00100000:3.0:1787383121.441194:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096c55d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5827:x1874206979523840:12345-0@lo:502: Request processed in 596us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383121.441203:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383121.441410:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5827:1874206979523840:0@lo:502: 00000020:01000000:1.0:1787383121.441439:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383121.441444:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383121.441446:0:5827:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383121.441451:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787383121.441629:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787383121.441648:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787383121.441707:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.441718:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383121.441734:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffc2750b800 from 1 10000000:01000000:3.0:1787383121.441737:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383121.441766:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.441773:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.441781:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383121.441797:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fa71e2f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523968:0@lo:101: 00000100:00100000:3.0:1787383121.441833:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383121.441984:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000022bb224e going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.442046:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979523968 00000100:00100000:0.0:1787383121.442055:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979523968 00000100:00100000:0.0:1787383121.442093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383121.442100:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0c296e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:5784:x1874206979523968:12345-0@lo:101: 00010000:00010000:0.0:1787383121.442109:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383121.442121:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce810 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.442141:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce810 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.442150:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce810 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.442157:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efcefde9, rc 0) 00000100:00100000:0.0:1787383121.442277:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0c296e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979523968:12345-0@lo:101: Request processed in 177us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.442285:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383121.442394:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fa71e2f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979523968:0@lo:101: 00010000:00010000:1.0:1787383121.442407:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.442415:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.443121:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524096:0@lo:256: 00000100:00100000:1.0:1787383121.443167:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.443244:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005afae06 going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.443282:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524096 00000100:00100000:3.0:1787383121.443288:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524096 00000100:00100000:3.0:1787383121.443376:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383121.443385:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5351cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979524096:12345-0@lo:256: 20000000:01000000:3.0:1787383121.443400:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787383121.443405:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787383121.443480:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5351cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979524096:12345-0@lo:256: Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383121.443489:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383121.443554:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524096:0@lo:256: 10000000:01000000:1.0:1787383121.444150:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383121.444169:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.444179:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383121.444186:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc2750b800 from 1 10000000:01000000:1.0:1787383121.444189:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383121.444215:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.444221:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.444228:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.444241:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524224:0@lo:101: 00000100:00100000:1.0:1787383121.444270:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.444539:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005afae06 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.444616:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524224 00000100:00100000:0.0:1787383121.444622:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524224 00000100:00100000:0.0:1787383121.444646:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383121.444652:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fd79751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:5784:x1874206979524224:12345-0@lo:101: 00010000:00010000:0.0:1787383121.444661:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383121.444672:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce81e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.444689:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce81e expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.444698:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce81e expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.444706:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000769a398e, rc 0) 00000100:00100000:0.0:1787383121.444741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fd79751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524224:12345-0@lo:101: Request processed in 89us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.444747:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383121.444815:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524224:0@lo:101: 00010000:00010000:1.0:1787383121.444825:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.444841:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.444978:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524352:0@lo:501: 00000100:00100000:1.0:1787383121.445004:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.445020:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005afae06 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.445074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524352 00000100:00100000:0.0:1787383121.445078:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524352 00000100:00100000:0.0:1787383121.445096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383121.445101:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc50e2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524352:12345-0@lo:501: 00000100:00100000:0.0:1787383121.445737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc50e2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524352:12345-0@lo:501: Request processed in 634us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.445745:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383121.446117:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524352:0@lo:501: 00000100:00100000:1.0:1787383121.446156:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524480:0@lo:503: 00000100:00100000:1.0:1787383121.446198:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.446219:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005afae06 going to sleep for 11 seconds 00000100:00100000:0.0:1787383121.446260:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524480 00000100:00100000:0.0:1787383121.446271:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524480 00000100:00100000:0.0:1787383121.446313:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383121.446321:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf7d93b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524480:12345-0@lo:503: 00000040:00080000:0.0:1787383121.446357:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383121.446402:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf7d93b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524480:12345-0@lo:503: Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.446409:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383121.446513:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524480:0@lo:503: 00000040:00080000:1.0:1787383121.447453:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787383121.447720:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787383121.447739:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383121.447799:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.447825:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383121.448029:0:5784:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787383121.448033:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffc2750b800 10000000:01000000:3.0:1787383121.448036:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffc2750b800 10000000:01000000:3.0:1787383121.448040:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383121.448046:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc2750b800 from 1 10000000:01000000:3.0:1787383121.448049:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383121.448085:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.448093:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.448103:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383121.448123:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000014ddef76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524608:0@lo:101: 00000100:00100000:3.0:1787383121.448180:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383121.448254:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000936685a1 going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.448273:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524608 00000100:00100000:3.0:1787383121.448279:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524608 00000100:00100000:0.0:1787383121.448426:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383121.448436:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da70f70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979524608:12345-0@lo:101: 00010000:00010000:0.0:1787383121.448449:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383121.448460:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce82c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.448481:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce82c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.448490:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce82c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.448498:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ddbbe97, rc 0) 00000100:00100000:0.0:1787383121.448541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da70f70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979524608:12345-0@lo:101: Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383121.448548:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383121.448623:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000014ddef76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524608:0@lo:101: 00010000:00010000:1.0:1787383121.448637:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.448645:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.448690:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524736:0@lo:501: 00000100:00100000:1.0:1787383121.448717:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.448741:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000006eb943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383121.448793:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524736 00000100:00100000:2.0:1787383121.448798:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524736 00000100:00100000:2.0:1787383121.448829:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383121.448836:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f998e09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979524736:12345-0@lo:501: 00000100:00100000:2.0:1787383121.449141:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f998e09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979524736:12345-0@lo:501: Request processed in 305us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383121.449149:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383121.449365:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524736:0@lo:501: 00000100:00100000:1.0:1787383121.449395:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524864:0@lo:503: 00000100:00100000:1.0:1787383121.449440:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.449459:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000006eb943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383121.449607:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524864 00000100:00100000:2.0:1787383121.449613:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524864 00000100:00100000:2.0:1787383121.449635:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383121.449642:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003afdd3d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979524864:12345-0@lo:503: 00000100:00100000:2.0:1787383121.450212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003afdd3d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979524864:12345-0@lo:503: Request processed in 569us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383121.450221:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383121.450419:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979524864:0@lo:503: 00000100:00100000:2.0:1787383121.450852:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098f84d97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5832:1874206979524992:0@lo:502: 00000100:00100000:3.0:1787383121.451167:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383121.451237:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 000000000536623b going to sleep for 11 seconds 00000100:00100000:2.0:1787383121.451278:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979524992 00000100:00100000:2.0:1787383121.451284:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979524992 00000100:00100000:2.0:1787383121.451367:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383121.451375:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1654a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5832:x1874206979524992:12345-0@lo:502: 00000100:00100000:2.0:1787383121.451640:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1654a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5832:x1874206979524992:12345-0@lo:502: Request processed in 266us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383121.451647:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383121.451730:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098f84d97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5832:1874206979524992:0@lo:502: 00000020:01000004:0.0:1787383121.451787:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787383121.451802:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000905bf932) 00000020:00000080:0.0:1787383121.451823:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787383121.452016:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004227a190 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787383121.452028:0:5832:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004227a190 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787383121.452030:0:5832:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004227a190 4 00010000:00080000:0.0:1787383121.452059:0:5832:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000044be588c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1787383121.453749:0:5832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787383121.453897:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787383121.453933:0:5832:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383121.453947:0:5832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42020b050d5ce841 00000100:00080000:0.0:1787383121.453957:0:5832:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383121.453962:0:5832:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000044be588c using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383121.453993:0:5832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f85c1c3c x1874206979525120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383121.454039:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f85c1c3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979525120:0@lo:38: 00000100:00100000:0.0:1787383121.454101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383121.454156:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525120 00000100:00100000:0.0:1787383121.454162:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525120 00000100:00100000:0.0:1787383121.454192:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383121.454199:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081da72bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979525120:12345-0@lo:38: 00000100:00100000:0.0:1787383121.454246:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081da72bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979525120:12345-0@lo:38: Request processed in 46us (145us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787383121.454253:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383121.454286:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383121.454307:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000044be588c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383121.454321:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787383121.454324:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f85c1c3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979525120:0@lo:38: 00000100:00080000:0.0:1787383121.454354:0:5832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383121.454512:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f85c1c3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5832:1874206979525248:0@lo:502: 00000100:00100000:0.0:1787383121.454554:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383121.456736:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8718b41 going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.456837:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525248 00000100:00100000:3.0:1787383121.456846:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525248 00000100:00100000:3.0:1787383121.460207:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383121.460221:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac590965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5832:x1874206979525248:12345-0@lo:502: 00000100:00100000:3.0:1787383121.460526:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac590965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5832:x1874206979525248:12345-0@lo:502: Request processed in 306us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383121.460535:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383121.461085:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f85c1c3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5832:1874206979525248:0@lo:502: 00000040:00080000:1.0:1787383121.461123:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787383121.461287:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787383121.461334:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383121.461393:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383121.461404:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787383121.461453:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787383121.461455:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383121.461457:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383121.461458:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383121.461459:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383121.461460:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383121.461463:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383121.461465:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383121.461466:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383121.461467:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383121.461469:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383121.461470:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383121.461473:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787383121.461476:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383121.461477:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383121.461478:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383121.461479:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383121.461480:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383121.461481:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383121.461482:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383121.461482:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383121.461483:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383121.461484:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383121.461485:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383121.461492:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383121.461511:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787383121.461525:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979525376:0@lo:253: 00000100:00100000:3.0:1787383121.461567:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383121.461601:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000067a8da4c going to sleep for 11 seconds 00000100:00100000:3.0:1787383121.461618:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525376 00000100:00100000:3.0:1787383121.461625:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525376 00000100:00100000:3.0:1787383121.461655:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383121.461662:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000703a3b23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5784:x1874206979525376:12345-0@lo:253: 20000000:01000000:3.0:1787383121.461683:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787383121.461695:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787383121.490173:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787383121.490193:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787383121.491943:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383121.491953:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383121.491995:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.492015:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce810 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.492023:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.492065:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.492079:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 12 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383121.492092:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979525504:0@lo:104: 00000100:00100000:0.0:1787383121.492161:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383121.492212:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc67d5de going to sleep for 11 seconds 00000100:00100000:1.0:1787383121.492289:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525504 00000100:00100000:1.0:1787383121.492306:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525504 00000100:00100000:1.0:1787383121.492353:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383121.492362:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000172365bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979525504:12345-0@lo:104: 00010000:00010000:1.0:1787383121.492373:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492424:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383121.492430:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000172365bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979525504:12345-0@lo:104: Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383121.492437:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787383121.492457:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383121.492461:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492468:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093fecc30 already unused, calling callback (00000000fa0b36ee) 10000000:00010000:1.0:1787383121.492471:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492478:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383121.492484:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383121.492497:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383121.492526:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492531:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383121.492554:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492560:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 0000000093fecc30/0x42020b050d5ce810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce817 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.492576:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383121.492578:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383121.492579:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383121.492705:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979525504:0@lo:104: 00010000:00010000:0.0:1787383121.492722:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383121.492852:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979525632:0@lo:103: 00000100:00100000:2.0:1787383121.493014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383121.493338:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525632 00000100:00100000:1.0:1787383121.493343:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525632 00010000:00010000:1.0:1787383121.493363:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 13 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383121.493394:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383121.493401:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000732c489e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3313:x1874206979525632:12345-0@lo:103: 00010000:00010000:1.0:1787383121.493412:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383121.493416:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 13 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493426:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 13 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493439:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efcefde9/0x42020b050d5ce817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce810 expref: 13 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493459:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493467:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383121.493480:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001528120s 00010000:00010000:1.0:1787383121.493484:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493490:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493496:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493501:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493507:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071f78826 already unused, calling callback (00000000806c3757) 00010000:00010000:1.0:1787383121.493511:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493517:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493527:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383121.493536:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383121.493577:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000732c489e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:3313:x1874206979525632:12345-0@lo:103: Request processed in 176us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383121.493584:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787383121.493646:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.493654:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383121.493659:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071f78826/0x42020b050d5ce848 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383121.493725:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d6a72c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979525632:0@lo:103: 00000100:00100000:2.0:1787383121.498720:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000703a3b23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5784:x1874206979525376:12345-0@lo:253: Request processed in 37051us (37145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383121.498736:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383121.498823:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5784:1874206979525376:0@lo:253: 10000000:01000000:3.0:1787383121.498839:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787383121.498842:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383121.498844:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383121.498845:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383121.498847:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383121.498848:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383121.498849:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383121.498850:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383121.498852:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383121.498853:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383121.498854:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383121.498856:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383121.498857:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787383121.499049:0:5784:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787383121.508218:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383121.508669:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383121.509273:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.509488:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383121.509683:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.510008:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383121.510645:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.510832:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383121.515080:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.515310:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383121.515515:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383121.515708:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787383121.556604:0:5784:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787383121.588843:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787383121.589214:0:5838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787383121.591502:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787383121.591660:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787383121.592176:0:5784:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787383121.592183:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787383121.592287:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383121.593138:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1787383121.595757:0:5837:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787383121.595768:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787383121.597730:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787383121.597817:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787383121.598512:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787383121.599287:0:5784:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787383121.601066:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787383121.601193:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787383121.601349:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787383121.601516:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787383121.602011:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787383121.602126:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787383121.602284:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787383121.602508:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787383121.602658:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787383121.603153:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787383121.603283:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787383121.603488:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787383121.603633:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787383121.603770:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787383121.603952:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787383121.604112:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787383121.604664:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787383121.604782:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787383121.604937:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787383121.605048:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787383121.605179:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787383121.605338:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787383121.605584:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787383121.605784:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787383121.605967:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787383121.606097:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787383121.606240:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787383121.606416:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787383121.606564:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787383121.606693:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787383121.606858:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787383121.607050:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787383121.607246:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787383121.628124:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787383121.663957:0:5784:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787383121.663995:0:5784:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc36401c5f988 00100000:10000000:2.0:1787383121.664003:0:5784:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787383121.665359:0:5784:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787383121.665376:0:5784:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787383121.665388:0:5784:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787383121.665403:0:5784:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787383121.700720:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787383121.700802:0:5838:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787383121.700807:0:5838:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787383121.739925:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383122.764530:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383123.786502:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383124.810862:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383125.544064:0:6081:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787383125.838891:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383126.794655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787383126.794665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787383126.794668:0:8:0:(import.c:65:import_set_state_nolock()) 0000000044be588c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383126.794681:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000044be588c using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1787383126.794717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dd42984e x1874206979525888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383126.794755:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd42984e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979525888:0@lo:38: 00000100:00100000:1.0:1787383126.794847:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383126.795037:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b1a6a9f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979525760:0@lo:400: 00000100:00100000:0.0:1787383126.795074:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383126.795124:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525888 00000100:00100000:0.0:1787383126.795132:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525888 00000100:00100000:0.0:1787383126.795163:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383126.795177:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acc43456 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1874206979525888:12345-0@lo:38: 00010000:00080000:0.0:1787383126.795203:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1787383126.795239:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42020b050d5ce84f 00000004:00100000:0.0:1787383126.795291:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383126.795441:0:5805:0:(import.c:65:import_set_state_nolock()) 000000001cf8cd97 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383126.795498:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acc43456 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874206979525888:12345-0@lo:38: Request processed in 320us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383126.795506:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383126.795736:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979525760 00000100:00100000:1.0:1787383126.795741:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979525760 00000100:00100000:1.0:1787383126.795961:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383126.795969:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074bce687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3314:x1874206979525760:12345-0@lo:400: 00000100:00100000:1.0:1787383126.796009:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074bce687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3314:x1874206979525760:12345-0@lo:400: Request processed in 41us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383126.796015:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787383126.796066:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd42984e x1874206979525888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383126.796081:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787383126.796088:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787383126.796093:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383126.796095:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000044be588c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383126.796101:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd42984e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979525888:0@lo:38: 00000100:00100000:2.0:1787383126.796225:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b1a6a9f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979525760:0@lo:400: 00010000:00010000:2.0:1787383126.857927:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383127.882185:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383128.907005:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787383129.354106:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787383129.354114:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffc2750b800 from 3 10000000:01000000:1.0:1787383129.354119:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383129.354172:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383129.354184:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383129.354214:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383129.354249:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dd42984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979526016:0@lo:101: 00000100:00100000:1.0:1787383129.354323:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383129.354384:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 0000000023f7bbde going to sleep for 11 seconds 00000100:00100000:2.0:1787383129.354457:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526016 00000100:00100000:2.0:1787383129.354466:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526016 00000100:00100000:2.0:1787383129.354528:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383129.354536:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2cb1ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5800:x1874206979526016:12345-0@lo:101: 00010000:00010000:2.0:1787383129.354549:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383129.354561:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2981e28/0x42020b050d5ce85d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce856 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383129.354582:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2981e28/0x42020b050d5ce85d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383129.354592:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2981e28/0x42020b050d5ce85d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383129.354600:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2981e28, rc 0) 00000100:00100000:2.0:1787383129.354716:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2cb1ab0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979526016:12345-0@lo:101: Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383129.354722:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383129.355330:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dd42984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979526016:0@lo:101: 00010000:00010000:3.0:1787383129.355347:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383129.355356:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383129.355414:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979526144:0@lo:256: 00000100:00100000:3.0:1787383129.355451:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383129.355680:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b72ae9f9 going to sleep for 11 seconds 00000100:00100000:1.0:1787383129.355932:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526144 00000100:00100000:1.0:1787383129.355939:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526144 00000100:00100000:1.0:1787383129.355981:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383129.355988:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd12b535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979526144:12345-0@lo:256: 20000000:01000000:1.0:1787383129.356006:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787383129.356024:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787383129.356028:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787383129.356104:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd12b535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979526144:12345-0@lo:256: Request processed in 116us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383129.356111:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383129.356395:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979526144:0@lo:256: 10000000:01000000:3.0:1787383129.356442:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383129.356449:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383129.356458:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000935f4a9f/0x42020b050d5ce856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383129.933934:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383130.111783:0:6283:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffea5c471e0 00000020:00000080:3.0:1787383130.111820:0:6283:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383130.111826:0:6283:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383130.111837:0:6283:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea5c49470 20000000:00000080:3.0:1787383130.111845:0:6283:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc2ca7ec00 uarg=0000000000000000 20000000:01000000:3.0:1787383130.111929:0:6283:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787383130.111939:0:6283:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787383130.111946:0:6283:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787383130.112317:0:6283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787383130.112331:0:6283:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787383130.120136:0:6283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383130.120454:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787383130.120519:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787383130.120593:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787383130.120615:0:6283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787383130.120747:0:6283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.120773:0:6283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce81e expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.121020:0:6283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.121079:0:6283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.121101:0:6283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 11 pid: 5796 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383130.121122:0:6283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6283:1874206979526272:0@lo:104: 00000100:00100000:3.0:1787383130.121226:0:6283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383130.121314:0:6283:0:(client.c:2702:ptlrpc_set_wait()) set 000000009335e922 going to sleep for 11 seconds 00000100:00100000:1.0:1787383130.121435:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526272 00000100:00100000:1.0:1787383130.121447:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526272 00000100:00100000:1.0:1787383130.121516:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383130.121528:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fbaa890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:6283:x1874206979526272:12345-0@lo:104: 00010000:00010000:1.0:1787383130.121545:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.121625:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787383130.121669:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383130.121677:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121684:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8f3aa45 already unused, calling callback (00000000fa0b36ee) 10000000:00010000:2.0:1787383130.121688:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121697:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383130.121704:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383130.121736:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787383130.121747:0:6283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6283:1874206979526272:0@lo:104: 00010000:00010000:3.0:1787383130.121768:0:6283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121775:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121781:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383130.121811:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121819:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce81e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce825 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383130.121844:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383130.121846:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383130.121847:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383130.121851:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fbaa890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:6283:x1874206979526272:12345-0@lo:104: Request processed in 106us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383130.121861:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383130.121893:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000070ccd7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979526400:0@lo:103: 00000100:00100000:2.0:1787383130.121929:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383130.122381:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526400 00000100:00100000:1.0:1787383130.122387:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526400 00010000:00010000:1.0:1787383130.122410:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 12 pid: 5796 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383130.122439:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383130.122447:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1d7e22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:3315:x1874206979526400:12345-0@lo:103: 00010000:00010000:1.0:1787383130.122459:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383130.122464:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 12 pid: 5796 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122475:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 12 pid: 5796 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122491:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000769a398e/0x42020b050d5ce825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce81e expref: 12 pid: 5796 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122510:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122519:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122535:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122543:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122549:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122567:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122573:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7abb417 already unused, calling callback (00000000806c3757) 00010000:00010000:1.0:1787383130.122577:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.122584:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.122743:0:6283:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383130.122752:0:6283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.126767:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.126846:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7abb417/0x42020b050d5ce864 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383130.126954:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383130.127061:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1d7e22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3315:x1874206979526400:12345-0@lo:103: Request processed in 4611us (5128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383130.127073:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383130.127790:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000070ccd7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979526400:0@lo:103: 00010000:00010000:3.0:1787383130.956858:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383131.922596:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979526528:0@lo:400: 00000100:00100000:0.0:1787383131.922696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383131.922761:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383131.922767:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000011d785a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979526656:0@lo:400: 00000100:00100000:0.0:1787383131.922798:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383131.922840:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526528 00000100:00100000:0.0:1787383131.922851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526528 00000100:00100000:0.0:1787383131.922933:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383131.922941:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008291896b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3312:x1874206979526528:12345-0@lo:400: 00000100:00100000:0.0:1787383131.922997:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008291896b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3312:x1874206979526528:12345-0@lo:400: Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383131.923005:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383131.923043:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526656 00000100:00100000:0.0:1787383131.923047:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526656 00000100:00100000:0.0:1787383131.923071:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383131.923076:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008669e3db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979526656:12345-0@lo:400: 00000100:00100000:0.0:1787383131.923107:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008669e3db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979526656:12345-0@lo:400: Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383131.923124:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787383131.923162:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000011d785a0 x1874206979526656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383131.923177:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000011d785a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979526656:0@lo:400: 00000100:00100000:0.0:1787383131.923186:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979526528:0@lo:400: 00010000:00010000:2.0:1787383131.978086:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383133.002521:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383134.027446:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383135.050184:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383135.724202:0:6596:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383135.724206:0:6596:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787383135.724347:0:6596:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000002d3e79c7 00000020:01000004:1.0:1787383135.724364:0:6596:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787383135.724376:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787383135.724397:0:6596:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000fc5535d2) 00000020:00000080:1.0:1787383135.724413:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787383135.737259:0:6596:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787383135.737585:0:6596:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787383135.759607:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787383135.765597:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787383135.765636:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787383135.765700:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787383135.765727:0:6596:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787383135.768490:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787383135.768502:0:6596:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787383135.768514:0:6596:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42020b050d5ce872 00000020:01000004:3.0:1787383135.768522:0:6596:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787383135.768544:0:6596:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787383135.768547:0:6596:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787383135.768552:0:6596:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787383135.768556:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787383135.768805:0:6596:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000e1952555) 00000020:00000080:3.0:1787383135.768821:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787383135.771641:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383135.771948:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383135.771955:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787383135.772934:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787383135.772945:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787383135.783494:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383135.783571:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787383135.785188:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383135.785351:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383135.785355:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787383135.785927:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787383135.785933:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787383135.814267:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383135.814698:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787383135.814715:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787383135.817225:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787383135.817241:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787383135.818087:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383135.818096:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787383135.820649:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383135.821009:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383135.821015:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787383135.821620:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787383135.821627:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787383135.876177:0:6596:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383135.876384:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383135.876390:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787383135.878353:0:6596:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787383135.878366:0:6596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787383135.879070:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787383135.879101:0:6596:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787383135.879108:0:6596:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787383135.900656:0:6596:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383135.900702:0:6596:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787383135.900710:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383135.900712:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383135.900713:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383135.900714:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383135.900715:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383135.900716:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383135.900718:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383135.900719:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383135.900720:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383135.900721:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383135.900723:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383135.900726:0:6596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787383135.900799:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383135.900800:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383135.900801:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383135.900802:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383135.900803:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383135.900804:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383135.900805:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383135.900805:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383135.900806:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383135.900807:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383135.900808:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383135.900844:0:6596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787383135.900863:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979526784:0@lo:253: 00000100:00100000:3.0:1787383135.901154:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383135.901257:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a848d4d going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.901340:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526784 00000100:00100000:0.0:1787383135.901349:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526784 00000100:00100000:0.0:1787383135.901403:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383135.901413:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000533db0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979526784:12345-0@lo:253: 20000000:01000000:0.0:1787383135.901441:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787383135.901445:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787383135.901450:0:5797:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787383135.901454:0:5797:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787383135.902604:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383135.902942:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787383135.902958:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787383135.903005:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787383135.903013:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787383135.903040:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787383135.903086:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787383135.903500:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787383135.903522:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:0.0:1787383135.903524:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:0.0:1787383135.903557:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787383135.903565:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787383135.903610:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787383135.903617:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:0.0:1787383135.903662:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787383135.903678:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787383135.903710:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787383135.903977:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787383135.904726:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787383135.907043:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:0.0:1787383135.907046:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:0.0:1787383135.907145:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787383135.907153:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787383135.907191:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787383135.907198:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:0.0:1787383135.907269:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787383135.907279:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787383135.907312:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787383135.907342:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787383135.907360:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787383135.907363:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787383135.907369:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787383135.907370:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787383135.907373:0:5797:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787383135.907384:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787383135.913801:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787383135.913895:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787383135.913897:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787383135.914649:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787383135.914800:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787383135.914849:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787383135.915332:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787383135.915371:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787383135.915398:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787383135.915407:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787383135.915409:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787383135.915852:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787383135.916250:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787383135.916307:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787383135.916589:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787383135.916628:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787383135.916682:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787383135.916695:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787383135.916697:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787383135.919827:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787383135.920501:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787383135.920584:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787383135.920680:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787383135.920700:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787383135.920722:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.920825:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.920832:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.920844:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce82c expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.920850:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.921284:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.921301:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 11 pid: 5796 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.921315:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979526912:0@lo:104: 00000100:00100000:0.0:1787383135.921384:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383135.921446:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.921454:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 11 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.921473:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091d155f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979527040:0@lo:104: 00000100:00100000:0.0:1787383135.921494:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383135.921525:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.921532:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 11 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.921539:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979527168:0@lo:104: 00000100:00100000:0.0:1787383135.921559:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.921568:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dc36f06b going to sleep for 11 seconds 00000100:00100000:1.0:1787383135.921633:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979526912 00000100:00100000:1.0:1787383135.921643:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979526912 00000100:00100000:1.0:1787383135.921681:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527040 00000100:00100000:1.0:1787383135.921684:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527040 00000100:00100000:1.0:1787383135.921692:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527168 00000100:00100000:1.0:1787383135.921694:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527168 00000100:00100000:1.0:1787383135.921706:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383135.921713:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d785a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5797:x1874206979526912:12345-0@lo:104: 00010000:00010000:1.0:1787383135.921746:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.921808:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383135.921813:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d785a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5797:x1874206979526912:12345-0@lo:104: Request processed in 101us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383135.921820:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383135.921839:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383135.921844:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fec190bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979527040:12345-0@lo:104: 00010000:00010000:1.0:1787383135.921851:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.921911:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383135.921916:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fec190bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979527040:12345-0@lo:104: Request processed in 73us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383135.921921:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383135.921933:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383135.921938:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007369bcd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979527168:12345-0@lo:104: 00010000:00010000:1.0:1787383135.921945:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.921968:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787383135.921972:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007369bcd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979527168:12345-0@lo:104: Request processed in 35us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383135.921976:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787383135.921992:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787383135.921997:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922009:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab537ede already unused, calling callback (00000000fa0b36ee) 10000000:00010000:1.0:1787383135.922012:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922020:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383135.922025:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383135.922030:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383135.922056:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922062:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383135.922076:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922083:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000ab537ede/0x42020b050d5ce82c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce833 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922096:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383135.922098:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922103:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008aeb9902 already unused, calling callback (00000000fa0b36ee) 10000000:00010000:1.0:1787383135.922105:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922121:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383135.922126:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383135.922130:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383135.922143:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922149:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383135.922154:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922169:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce7bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7c3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922179:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383135.922181:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922186:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000000cf188d already unused, calling callback (00000000fa0b36ee) 10000000:00010000:1.0:1787383135.922188:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922194:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383135.922199:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383135.922210:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383135.922223:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922229:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383135.922240:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922245:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 0000000000cf188d/0x42020b050d5ce7a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce7a7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922259:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383135.922260:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383135.922261:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383135.922395:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000060a31dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979527552:0@lo:103: 00000100:00100000:0.0:1787383135.922428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.922489:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d018973 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979526912:0@lo:104: 00000100:00100000:0.0:1787383135.922497:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091d155f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979527040:0@lo:104: 00000100:00100000:0.0:1787383135.922502:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979527168:0@lo:104: 00010000:00010000:0.0:1787383135.922521:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.922576:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527552 00000100:00100000:1.0:1787383135.922581:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527552 00010000:00010000:1.0:1787383135.922599:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 12 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.922628:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383135.922635:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000865989a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:3312:x1874206979527552:12345-0@lo:103: 00010000:00010000:1.0:1787383135.922645:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383135.922648:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 12 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922657:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 12 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922669:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c913875d/0x42020b050d5ce7a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce7a0 expref: 12 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.922689:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383135.922715:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000865989a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3312:x1874206979527552:12345-0@lo:103: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383135.922721:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383135.922818:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000060a31dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979527552:0@lo:103: 00010000:00010000:0.0:1787383135.923013:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383135.923080:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd6e2aa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979527296:0@lo:103: 00000100:00100000:2.0:1787383135.923112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383135.923181:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383135.923187:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000476d2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979527424:0@lo:103: 00000100:00100000:2.0:1787383135.923208:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.923344:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527296 00000100:00100000:1.0:1787383135.923349:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527296 00010000:00010000:1.0:1787383135.925153:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 11 pid: 5796 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.925251:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527424 00000100:00100000:1.0:1787383135.925258:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527424 00010000:00010000:1.0:1787383135.925273:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 12 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.925331:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383135.925343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070ccd7bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:3314:x1874206979527296:12345-0@lo:103: 00010000:00010000:0.0:1787383135.925358:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383135.925363:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 12 pid: 5796 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925388:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 12 pid: 5796 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925406:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ddbbe97/0x42020b050d5ce833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce82c expref: 12 pid: 5796 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925421:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383135.925495:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070ccd7bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3314:x1874206979527296:12345-0@lo:103: Request processed in 155us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.925502:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383135.925519:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383135.925526:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029b676c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:3314:x1874206979527424:12345-0@lo:103: 00010000:00010000:0.0:1787383135.925533:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383135.925536:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 10 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925544:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 10 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925554:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007008655/0x42020b050d5ce7c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce7bc expref: 10 pid: 5797 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925565:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925572:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925588:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925600:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925607:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925613:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925619:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000945722d8 already unused, calling callback (00000000806c3757) 00010000:00010000:0.0:1787383135.925623:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925631:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925647:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.925659:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383135.925698:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029b676c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:3314:x1874206979527424:12345-0@lo:103: Request processed in 173us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.925704:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383135.925774:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000476d2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979527424:0@lo:103: 00000100:00100000:3.0:1787383135.925786:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd6e2aa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979527296:0@lo:103: 00010000:00010000:0.0:1787383135.927606:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.927624:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.927631:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000945722d8/0x42020b050d5ce880 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383135.927662:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787383135.963062:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000533db0ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:6596:x1874206979526784:12345-0@lo:253: Request processed in 61642us (61899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.963080:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383135.963215:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059aac075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979526784:0@lo:253: 10000000:01000000:1.0:1787383135.963234:0:6596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787383135.963237:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383135.963240:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383135.963241:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383135.963242:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787383135.963244:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383135.963245:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383135.963247:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383135.963249:0:6596:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787383135.963250:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383135.963252:0:6596:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383135.963275:0:6596:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002d3e79c7 from lustre-OST0000 10000000:01000000:1.0:1787383135.963301:0:6596:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787383135.963304:0:6596:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383135.963312:0:6596:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffc173ecd40 local copy 10000000:01000000:1.0:1787383135.963316:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787383135.963365:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.963375:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.963384:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.963404:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527680:0@lo:101: 00000100:00100000:1.0:1787383135.963440:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.963497:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009cbbb01a going to sleep for 11 seconds 00000100:00100000:2.0:1787383135.963599:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527680 00000100:00100000:2.0:1787383135.963607:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527680 00000100:00100000:2.0:1787383135.963688:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383135.963704:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000796c1590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:6596:x1874206979527680:12345-0@lo:101: 00010000:00010000:2.0:1787383135.963717:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383135.963739:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c5497fc/0x42020b050d5ce88e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce887 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383135.963761:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c5497fc/0x42020b050d5ce88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce887 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383135.963771:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c5497fc/0x42020b050d5ce88e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce887 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383135.963779:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c5497fc, rc 0) 00000100:00100000:2.0:1787383135.963817:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000796c1590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:6596:x1874206979527680:12345-0@lo:101: Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383135.963823:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383135.964251:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527680:0@lo:101: 00010000:00010000:1.0:1787383135.964269:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.964279:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.964389:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527808:0@lo:501: 00000100:00100000:1.0:1787383135.964420:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.964701:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009cbbb01a going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.964813:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527808 00000100:00100000:0.0:1787383135.964818:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527808 00000100:00100000:3.0:1787383135.964858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383135.964883:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dd042c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:6596:x1874206979527808:12345-0@lo:501: 00000100:00100000:3.0:1787383135.965111:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dd042c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:6596:x1874206979527808:12345-0@lo:501: Request processed in 245us (690us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383135.965119:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383135.965214:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527808:0@lo:501: 10000000:01000000:1.0:1787383135.965228:0:6596:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383135.965256:0:6596:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383135.965261:0:6596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.965269:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.965281:0:6596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.965304:0:6596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787383135.965324:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffc3dc13000 10000000:01000000:1.0:1787383135.965329:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383135.965334:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ffc173ecd40 10000000:01000000:1.0:1787383135.965336:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787383135.965339:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ffc173ecd40 from 1 10000000:01000000:1.0:1787383135.965342:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787383135.965364:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.965371:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.965378:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.965391:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527936:0@lo:101: 00000100:00100000:1.0:1787383135.965418:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.965436:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00010000:00010000:3.0:1787383135.965489:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383135.965496:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965503:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008aeb9902 already unused, calling callback (00000000fa0b36ee) 10000000:00010000:3.0:1787383135.965506:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965513:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383135.965520:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383135.965525:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383135.965543:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965549:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383135.965577:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965584:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 000000008aeb9902/0x42020b050d5ce887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce88e expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965601:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383135.965602:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383135.965613:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383135.965622:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979527936 00000100:00100000:3.0:1787383135.965627:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979527936 00000100:00100000:3.0:1787383135.965645:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383135.965651:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007249da75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:6596:x1874206979527936:12345-0@lo:101: 00010000:00010000:3.0:1787383135.965659:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383135.965671:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e9a6c6a/0x42020b050d5ce89c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce895 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965688:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e9a6c6a/0x42020b050d5ce89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce895 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965696:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e9a6c6a/0x42020b050d5ce89c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce895 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.965704:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e9a6c6a, rc 0) 00000100:00100000:3.0:1787383135.965745:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007249da75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979527936:12345-0@lo:101: Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.965751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383135.965903:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000085a3cd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979528064:0@lo:103: 00000100:00100000:1.0:1787383135.965934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.965974:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979527936:0@lo:101: 00010000:00010000:1.0:1787383135.965986:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.966003:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383135.966019:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787383135.966029:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.966035:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000f0dfde2b/0x42020b050d5ce895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383135.966043:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383135.966047:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383135.966052:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787383135.966054:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383135.966067:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.966073:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.966080:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.966091:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528192:0@lo:101: 00000100:00100000:1.0:1787383135.966113:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.966123:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00000100:00100000:3.0:1787383135.966221:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528064 00000100:00100000:3.0:1787383135.966226:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528064 00000100:00100000:3.0:1787383135.966258:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383135.966264:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8b4e2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:3313:x1874206979528064:12345-0@lo:103: 00010000:00010000:3.0:1787383135.966273:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383135.966284:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c5497fc/0x42020b050d5ce88e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ce887 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.966296:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383135.966319:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8b4e2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:3313:x1874206979528064:12345-0@lo:103: Request processed in 56us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.966331:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383135.966349:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528192 00000100:00100000:3.0:1787383135.966352:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528192 00000100:00100000:3.0:1787383135.966365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383135.966371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f896c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:6596:x1874206979528192:12345-0@lo:101: 00010000:00010000:3.0:1787383135.966378:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383135.966385:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035183b2b/0x42020b050d5ce8aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce8a3 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.966399:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035183b2b/0x42020b050d5ce8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.966407:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035183b2b/0x42020b050d5ce8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383135.966413:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035183b2b, rc 0) 00000100:00100000:3.0:1787383135.966437:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f896c9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528192:12345-0@lo:101: Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.966442:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383135.966524:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000085a3cd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979528064:0@lo:103: 00000100:00100000:1.0:1787383135.966547:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528192:0@lo:101: 00010000:00010000:1.0:1787383135.966561:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383135.966568:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383135.966653:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528320:0@lo:501: 00000100:00100000:1.0:1787383135.966678:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.966707:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00000100:00100000:3.0:1787383135.966808:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528320 00000100:00100000:3.0:1787383135.966812:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528320 00000100:00100000:3.0:1787383135.966827:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383135.966831:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a9f858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528320:12345-0@lo:501: 00000100:00100000:3.0:1787383135.967057:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a9f858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528320:12345-0@lo:501: Request processed in 224us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.967062:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383135.967196:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528320:0@lo:501: 00000100:00100000:1.0:1787383135.967231:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528448:0@lo:503: 00000100:00100000:1.0:1787383135.967271:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.967298:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00000100:00100000:3.0:1787383135.967339:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528448 00000100:00100000:3.0:1787383135.967343:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528448 00000100:00100000:3.0:1787383135.967376:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383135.967382:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0794b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528448:12345-0@lo:503: 00000100:00100000:3.0:1787383135.967534:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0794b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528448:12345-0@lo:503: Request processed in 152us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.967541:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383135.967647:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528448:0@lo:503: 00000040:00080000:1.0:1787383135.968072:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383135.968167:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528576:0@lo:502: 00000100:00100000:1.0:1787383135.968207:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.968227:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00000100:00100000:3.0:1787383135.968372:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528576 00000100:00100000:3.0:1787383135.968377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528576 00000100:00100000:3.0:1787383135.968408:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383135.968414:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c0102fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528576:12345-0@lo:502: 00000100:00100000:3.0:1787383135.968556:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c0102fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528576:12345-0@lo:502: Request processed in 142us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.968563:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383135.968679:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528576:0@lo:502: 00000040:00080000:1.0:1787383135.969016:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787383135.969067:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787383135.969101:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787383135.969149:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787383135.969205:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787383135.969239:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787383135.969266:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528704:0@lo:502: 00000100:00100000:1.0:1787383135.969312:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383135.969342:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b687f24 going to sleep for 11 seconds 00000100:00100000:3.0:1787383135.969401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528704 00000100:00100000:3.0:1787383135.969406:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528704 00000100:00100000:3.0:1787383135.969490:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383135.969498:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000480f4085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528704:12345-0@lo:502: 00000100:00100000:3.0:1787383135.969639:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000480f4085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528704:12345-0@lo:502: Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383135.969646:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383135.969924:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f5988f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528704:0@lo:502: 00000040:00080000:1.0:1787383135.970011:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787383135.970021:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787383135.970668:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383135.970676:0:6614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787383135.970682:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.970685:0:6614:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787383135.970690:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383135.970705:0:6614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000032e3034d) 00000020:00000080:1.0:1787383135.970806:0:6614:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787383135.970814:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787383135.970980:0:6614:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002d3e79c7 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787383135.970987:0:6614:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383135.970994:0:6614:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42020b050d5ce8b8 00010000:00010000:1.0:1787383135.975584:0:6614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787383135.976200:0:6614:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787383135.982487:0:6614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787383135.982975:0:6614:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787383135.988634:0:6614:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787383135.989247:0:6614:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787383135.990281:0:6614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787383135.990297:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383135.990305:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.990307:0:6614:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787383135.990311:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383135.990315:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.990316:0:6614:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383135.990320:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383135.990321:0:6614:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787383135.990369:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383135.990371:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.990372:0:6614:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383135.990375:0:6614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787383135.992416:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787383135.992445:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383135.992461:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.992471:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000a8f3aa45/0x42020b050d5ce8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383135.992477:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3dc13000 from 1 10000000:01000000:0.0:1787383135.992480:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383135.992519:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000945722d8/0x42020b050d5ce8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.992527:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000945722d8/0x42020b050d5ce8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.992536:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000945722d8/0x42020b050d5ce8bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.992558:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528832:0@lo:101: 00000100:00100000:0.0:1787383135.992625:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.992662:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cad5604d going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.992690:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528832 00000100:00100000:0.0:1787383135.992702:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528832 00000100:00100000:0.0:1787383135.993860:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383135.993885:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009202d33c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+10:6596:x1874206979528832:12345-0@lo:101: 00010000:00010000:0.0:1787383135.993899:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383135.993911:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ccd61f5/0x42020b050d5ce8c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce8bf expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.993932:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ccd61f5/0x42020b050d5ce8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.993939:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ccd61f5/0x42020b050d5ce8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.993946:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ccd61f5, rc 0) 00000100:00100000:0.0:1787383135.993990:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009202d33c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979528832:12345-0@lo:101: Request processed in 110us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.993996:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383135.994044:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528832:0@lo:101: 00010000:00010000:0.0:1787383135.994056:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000945722d8/0x42020b050d5ce8bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383135.994062:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000945722d8/0x42020b050d5ce8bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383135.994148:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528960:0@lo:501: 00000100:00100000:0.0:1787383135.994186:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.994217:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cad5604d going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.994231:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979528960 00000100:00100000:0.0:1787383135.994234:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979528960 00000100:00100000:0.0:1787383135.994260:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383135.994266:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068f1a2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979528960:12345-0@lo:501: 00000100:00100000:0.0:1787383135.994482:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068f1a2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979528960:12345-0@lo:501: Request processed in 216us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.994486:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383135.994506:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979528960:0@lo:501: 00000100:00100000:0.0:1787383135.994523:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529088:0@lo:503: 00000100:00100000:0.0:1787383135.994549:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.994557:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cad5604d going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.994565:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529088 00000100:00100000:0.0:1787383135.994567:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529088 00000100:00100000:0.0:1787383135.994578:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383135.994581:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048e1cd6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529088:12345-0@lo:503: 00000100:00100000:0.0:1787383135.994715:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048e1cd6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529088:12345-0@lo:503: Request processed in 133us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.994719:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383135.995113:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529088:0@lo:503: 00000040:00080000:0.0:1787383135.995426:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383135.995482:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529216:0@lo:502: 00000100:00100000:0.0:1787383135.995520:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.995544:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cad5604d going to sleep for 11 seconds 00000100:00100000:0.0:1787383135.995561:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529216 00000100:00100000:0.0:1787383135.995564:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529216 00000100:00100000:0.0:1787383135.995590:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383135.995594:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da33772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529216:12345-0@lo:502: 00000100:00100000:0.0:1787383135.995691:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da33772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529216:12345-0@lo:502: Request processed in 96us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383135.995700:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383135.996941:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529216:0@lo:502: 00000040:00080000:0.0:1787383135.997149:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787383135.997216:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787383135.997242:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529344:0@lo:502: 00000100:00100000:0.0:1787383135.997290:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383135.997767:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cad5604d going to sleep for 11 seconds 00000100:00100000:2.0:1787383135.998799:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529344 00000100:00100000:2.0:1787383135.998809:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529344 00000100:00100000:2.0:1787383135.998908:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383135.998916:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069dfcd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529344:12345-0@lo:502: 00000100:00100000:2.0:1787383135.999104:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069dfcd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529344:12345-0@lo:502: Request processed in 189us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383135.999109:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383135.999218:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000035d68c81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529344:0@lo:502: 00000040:00080000:1.0:1787383135.999361:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787383135.999375:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787383135.999753:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383135.999761:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.999763:0:6618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787383135.999767:0:6618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc3dc13000 00000020:00000080:1.0:1787383135.999769:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383135.999794:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383135.999796:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383135.999798:0:6618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787383135.999800:0:6618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787383135.999960:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787383135.999977:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383135.999997:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.000005:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383136.000033:0:6596:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383136.000035:0:6596:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffc3dc13000 10000000:01000000:0.0:1787383136.000037:0:6596:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffc3dc13000 10000000:01000000:0.0:1787383136.000040:0:6596:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383136.000044:0:6596:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc3dc13000 from 1 10000000:01000000:0.0:1787383136.000045:0:6596:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383136.000071:0:6596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.000076:0:6596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.000083:0:6596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383136.000104:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529472:0@lo:101: 00000100:00100000:0.0:1787383136.000138:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.000306:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383136.000359:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529472 00000100:00100000:3.0:1787383136.000363:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529472 00000100:00100000:3.0:1787383136.000384:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787383136.000389:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979529472:12345-0@lo:101: 00010000:00010000:3.0:1787383136.000398:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383136.000407:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce8cd expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383136.000424:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383136.000437:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383136.000444:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01663a00, rc 0) 00000100:00100000:3.0:1787383136.000476:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529472:12345-0@lo:101: Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383136.000480:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383136.000535:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529472:0@lo:101: 00010000:00010000:0.0:1787383136.000544:0:6596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.000550:0:6596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383136.000613:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529600:0@lo:501: 00000100:00100000:0.0:1787383136.000631:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.000647:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383136.000680:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529600 00000100:00100000:3.0:1787383136.000682:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529600 00000100:00100000:3.0:1787383136.000694:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383136.000697:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529600:12345-0@lo:501: 00000100:00100000:3.0:1787383136.000951:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529600:12345-0@lo:501: Request processed in 252us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383136.000956:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787383136.001011:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529600:0@lo:501: 00000100:00100000:0.0:1787383136.001029:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529728:0@lo:503: 00000100:00100000:0.0:1787383136.001053:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.001072:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383136.001105:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529728 00000100:00100000:3.0:1787383136.001108:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529728 00000100:00100000:3.0:1787383136.001120:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383136.001124:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529728:12345-0@lo:503: 00000100:00100000:3.0:1787383136.001256:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529728:12345-0@lo:503: Request processed in 131us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383136.001262:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383136.001329:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529728:0@lo:503: 00000040:00080000:0.0:1787383136.001524:0:6596:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383136.001560:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529856:0@lo:502: 00000100:00100000:0.0:1787383136.001583:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.001599:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383136.001634:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529856 00000100:00100000:3.0:1787383136.001637:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529856 00000100:00100000:3.0:1787383136.001650:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383136.001653:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529856:12345-0@lo:502: 00000100:00100000:0.0:1787383136.002032:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529856:12345-0@lo:502: Request processed in 377us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383136.002038:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383136.002084:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529856:0@lo:502: 00000040:00080000:1.0:1787383136.002292:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787383136.002344:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787383136.002375:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787383136.002409:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787383136.002429:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787383136.002463:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787383136.002485:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787383136.002501:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787383136.002526:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787383136.002553:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787383136.002570:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787383136.002601:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787383136.002621:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787383136.002637:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787383136.002660:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787383136.002685:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787383136.002701:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787383136.002724:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787383136.002820:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787383136.002852:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787383136.003062:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787383136.003083:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787383136.003099:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787383136.003121:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787383136.003139:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787383136.003191:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787383136.003236:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787383136.003257:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787383136.003291:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529984:0@lo:502: 00000100:00100000:1.0:1787383136.003346:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383136.003407:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383136.003436:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979529984 00000100:00100000:2.0:1787383136.003439:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979529984 00000100:00100000:2.0:1787383136.003496:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383136.003504:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529984:12345-0@lo:502: 00000100:00100000:2.0:1787383136.003689:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979529984:12345-0@lo:502: Request processed in 186us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383136.003700:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383136.003825:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979529984:0@lo:502: 00000040:00080000:0.0:1787383136.003909:0:6596:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787383136.003919:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787383136.004361:0:6619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787383136.004378:0:6619:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ffc0cf34d40) 00000020:00000080:0.0:1787383136.004396:0:6619:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787383136.004532:0:6619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc3dc13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787383136.004536:0:6619:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc3dc13000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787383136.004538:0:6619:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3dc13000 3 00010000:00080000:0.0:1787383136.004558:0:6619:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc3ff80000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1787383136.008250:0:6619:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787383136.008349:0:6619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787383136.008389:0:6619:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383136.008401:0:6619:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x42020b050d5ce8e2 00000100:00080000:0.0:1787383136.008412:0:6619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383136.008419:0:6619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ffc3ff80000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383136.008456:0:6619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc05151f80 x1874206979530112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383136.008495:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979530112:0@lo:38: 00000100:00100000:0.0:1787383136.008556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.008605:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530112 00000100:00100000:0.0:1787383136.008610:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530112 00000100:00100000:0.0:1787383136.008630:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383136.008635:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979530112:12345-0@lo:38: 00010000:00080000:0.0:1787383136.008652:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1787383136.008675:0:5803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42020b050d5ce8e9 00000004:00100000:0.0:1787383136.008686:0:5803:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383136.008707:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9ffc3ff87000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383136.008959:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874206979530112:12345-0@lo:38: Request processed in 322us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383136.008965:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787383136.008980:0:6619:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383136.009020:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979530240:0@lo:400: 00000100:00100000:0.0:1787383136.009036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.009058:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530240 00000100:00100000:0.0:1787383136.009060:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530240 00000100:00100000:0.0:1787383136.009078:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383136.009082:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979530240:12345-0@lo:400: 00000100:00100000:0.0:1787383136.009104:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979530240:12345-0@lo:400: Request processed in 22us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383136.009108:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787383136.009129:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc05150000 x1874206979530240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383136.009139:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979530240:0@lo:400: 00000040:00080000:0.0:1787383136.010006:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787383136.010910:0:6596:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787383136.010935:0:6596:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383136.010953:0:6596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383136.010962:0:6596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787383136.011008:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787383136.011009:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383136.011010:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383136.011011:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383136.011012:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383136.011013:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383136.011014:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383136.011015:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383136.011016:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383136.011020:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383136.011021:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383136.011025:0:6596:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787383136.011026:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383136.011027:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383136.011028:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383136.011028:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383136.011029:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383136.011029:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383136.011030:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383136.011031:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383136.011031:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383136.011032:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383136.011032:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383136.011052:0:6596:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787383136.011065:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979530368:0@lo:253: 00000100:00100000:1.0:1787383136.011114:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383136.011143:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383136.011218:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530368 00000100:00100000:0.0:1787383136.011225:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530368 00000100:00100000:0.0:1787383136.011267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787383136.011274:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6596:x1874206979530368:12345-0@lo:253: 20000000:01000000:0.0:1787383136.011294:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787383136.011305:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787383136.011848:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc05151f80 x1874206979530112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383136.011879:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383136.011887:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787383136.011894:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383136.011898:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383136.011900:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3ff80000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383136.011906:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979530112:0@lo:38: 20000000:01000000:1.0:1787383136.031685:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383136.031704:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787383136.031900:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383136.031907:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383136.031932:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.031973:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.031982:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032027:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032042:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383136.032059:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979530496:0@lo:104: 00000100:00100000:0.0:1787383136.032132:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.032230:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383136.032315:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530496 00000100:00100000:1.0:1787383136.032323:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530496 00000100:00100000:1.0:1787383136.032370:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383136.032379:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979530496:12345-0@lo:104: 00010000:00010000:1.0:1787383136.032392:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383136.032442:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383136.032448:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979530496:12345-0@lo:104: Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383136.032455:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787383136.032523:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383136.032530:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032537:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383136.032541:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032549:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383136.032556:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383136.032573:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383136.032611:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032618:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383136.032637:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032645:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5ce856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce85d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032661:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383136.032662:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383136.032664:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383136.032675:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979530624:0@lo:103: 00000100:00100000:0.0:1787383136.032709:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383136.032759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530624 00000100:00100000:0.0:1787383136.032763:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530624 00010000:00010000:0.0:1787383136.032781:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 13 pid: 5798 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383136.032803:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383136.032810:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3315:x1874206979530624:12345-0@lo:103: 00010000:00010000:0.0:1787383136.032820:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383136.032825:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 13 pid: 5798 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032834:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 13 pid: 5798 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032856:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032864:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383136.032902:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001528120s 00010000:00010000:0.0:1787383136.032906:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032914:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032922:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032929:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032934:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383136.032938:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032945:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032954:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.032965:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383136.032994:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3315:x1874206979530624:12345-0@lo:103: Request processed in 185us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383136.033007:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383136.033071:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979530624:0@lo:103: 00010000:00010000:0.0:1787383136.033098:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce85d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce856 expref: 12 pid: 5798 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383136.033109:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979530496:0@lo:104: 00010000:00010000:0.0:1787383136.033119:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.033128:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.033134:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383136.033140:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383136.039994:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:6596:x1874206979530368:12345-0@lo:253: Request processed in 28708us (28866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383136.040031:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787383136.040167:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6596:1874206979530368:0@lo:253: 10000000:01000000:3.0:1787383136.040184:0:6596:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787383136.040187:0:6596:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383136.040189:0:6596:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383136.040190:0:6596:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383136.040191:0:6596:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383136.040192:0:6596:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383136.040194:0:6596:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383136.040195:0:6596:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383136.040197:0:6596:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383136.040198:0:6596:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383136.040200:0:6596:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383136.040201:0:6596:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787383136.040217:0:6596:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787383136.047914:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787383136.051968:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787383136.052297:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787383136.052494:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787383136.052710:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787383136.053085:0:6596:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787383136.054087:0:6596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787383136.075288:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787383136.272970:0:6596:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787383136.272980:0:6596:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787383136.275838:0:6596:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383136.275946:0:6596:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383136.275972:0:6596:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787383136.276011:0:6596:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787383137.102057:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383138.122999:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383139.146145:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787383139.274252:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787383139.274260:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc2750b800 from 21 10000000:01000000:1.0:1787383139.274263:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383139.274312:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383139.274324:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383139.274336:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383139.274361:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979530752:0@lo:101: 00000100:00100000:1.0:1787383139.274431:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383139.274495:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08f12a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.274628:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530752 00000100:00100000:0.0:1787383139.274635:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530752 00000100:00100000:0.0:1787383139.274768:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383139.274778:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:5800:x1874206979530752:12345-0@lo:101: 00010000:00010000:0.0:1787383139.274801:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383139.274814:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce8f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.274836:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.274848:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.274857:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047000, rc 0) 00000100:00100000:0.0:1787383139.274936:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979530752:12345-0@lo:101: Request processed in 160us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.274944:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787383139.275244:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979530752:0@lo:101: 00010000:00010000:3.0:1787383139.275259:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383139.275277:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383139.275333:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979530880:0@lo:501: 00000100:00100000:3.0:1787383139.275360:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383139.275389:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.275431:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979530880 00000100:00100000:1.0:1787383139.275436:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979530880 00000100:00100000:1.0:1787383139.275457:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383139.275479:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979530880:12345-0@lo:501: 00000100:00100000:1.0:1787383139.276104:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979530880:12345-0@lo:501: Request processed in 623us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.276113:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383139.276370:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979530880:0@lo:501: 00000100:00100000:3.0:1787383139.276422:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531008:0@lo:503: 00000100:00100000:3.0:1787383139.276474:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383139.276502:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.276629:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531008 00000100:00100000:1.0:1787383139.276634:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531008 00000100:00100000:1.0:1787383139.276738:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383139.276747:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979531008:12345-0@lo:503: 00000100:00100000:1.0:1787383139.277096:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979531008:12345-0@lo:503: Request processed in 349us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.277104:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787383139.277311:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531008:0@lo:503: 00000100:00100000:1.0:1787383139.277762:0:6785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6785:1874206979531136:0@lo:502: 00000100:00100000:1.0:1787383139.277803:0:6785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383139.277834:0:6785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08f120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.277895:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531136 00000100:00100000:0.0:1787383139.277900:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531136 00000100:00100000:0.0:1787383139.277932:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383139.277939:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6785:x1874206979531136:12345-0@lo:502: 00000100:00100000:0.0:1787383139.278350:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6785:x1874206979531136:12345-0@lo:502: Request processed in 409us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.278357:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383139.287090:0:6785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6785:1874206979531136:0@lo:502: 00000100:00100000:0.0:1787383139.287276:0:6785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6785:1874206979531264:0@lo:502: 00000100:00100000:0.0:1787383139.287355:0:6785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.287400:0:6785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.287468:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531264 00000100:00100000:1.0:1787383139.287475:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531264 00000100:00100000:1.0:1787383139.287561:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383139.287572:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6785:x1874206979531264:12345-0@lo:502: 00000100:00100000:1.0:1787383139.287833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:6785:x1874206979531264:12345-0@lo:502: Request processed in 262us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.287841:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787383139.291227:0:6785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6785:1874206979531264:0@lo:502: 00000040:00080000:0.0:1787383139.291276:0:6785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787383139.293606:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787383139.293640:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383139.293664:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383139.293678:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383139.293689:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383139.293691:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffc2750b800 from 4 10000000:01000000:2.0:1787383139.293694:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383139.293745:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383139.293753:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383139.293765:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383139.293795:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531392:0@lo:101: 00000100:00100000:2.0:1787383139.293918:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383139.293967:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc03ec8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.294096:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531392 00000100:00100000:0.0:1787383139.294111:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531392 00000100:00100000:0.0:1787383139.294175:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383139.294185:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979531392:12345-0@lo:101: 00010000:00010000:0.0:1787383139.294198:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383139.294212:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce905 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294235:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce905 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294246:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce905 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294255:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046c00, rc 0) 00000100:00100000:0.0:1787383139.294296:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979531392:12345-0@lo:101: Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.294302:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383139.294346:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531392:0@lo:101: 00010000:00010000:0.0:1787383139.294359:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294367:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.294415:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531520:0@lo:256: 00000100:00100000:0.0:1787383139.294444:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.294456:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.294466:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531520 00000100:00100000:0.0:1787383139.294469:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531520 00000100:00100000:0.0:1787383139.294489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787383139.294495:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979531520:12345-0@lo:256: 20000000:01000000:0.0:1787383139.294507:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383139.294522:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383139.294525:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787383139.294588:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979531520:12345-0@lo:256: Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.294595:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787383139.294621:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531520:0@lo:256: 10000000:01000000:0.0:1787383139.294673:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383139.294679:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294688:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383139.294695:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787383139.294697:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787383139.294699:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383139.294716:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294722:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294729:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.294740:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531648:0@lo:101: 00000100:00100000:0.0:1787383139.294771:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.294783:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.294793:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531648 00000100:00100000:0.0:1787383139.294797:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531648 00000100:00100000:0.0:1787383139.294811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383139.294816:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979531648:12345-0@lo:101: 00010000:00010000:0.0:1787383139.294822:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383139.294829:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce913 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294843:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce913 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294852:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce913 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294859:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046200, rc 0) 00000100:00100000:0.0:1787383139.294910:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979531648:12345-0@lo:101: Request processed in 93us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.294915:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383139.294941:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531648:0@lo:101: 00010000:00010000:0.0:1787383139.294950:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.294958:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.295001:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531776:0@lo:501: 00000100:00100000:0.0:1787383139.295031:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.295042:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.295051:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531776 00000100:00100000:0.0:1787383139.295054:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531776 00000100:00100000:0.0:1787383139.295069:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383139.295075:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979531776:12345-0@lo:501: 00000100:00100000:0.0:1787383139.295333:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979531776:12345-0@lo:501: Request processed in 256us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.295340:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383139.295365:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531776:0@lo:501: 00000100:00100000:0.0:1787383139.295388:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531904:0@lo:503: 00000100:00100000:0.0:1787383139.295420:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.295432:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.295442:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979531904 00000100:00100000:0.0:1787383139.295444:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979531904 00000100:00100000:0.0:1787383139.295459:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383139.295464:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979531904:12345-0@lo:503: 00000100:00100000:0.0:1787383139.295746:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979531904:12345-0@lo:503: Request processed in 280us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.295752:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383139.295785:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979531904:0@lo:503: 00000100:00100000:0.0:1787383139.296006:0:6787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6787:1874206979532032:0@lo:502: 00000100:00100000:0.0:1787383139.296036:0:6787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.296054:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532032 00000100:00100000:0.0:1787383139.296057:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532032 00000100:00100000:0.0:1787383139.296075:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383139.296087:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:6787:x1874206979532032:12345-0@lo:502: 00000100:00100000:0.0:1787383139.296273:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:6787:x1874206979532032:12345-0@lo:502: Request processed in 185us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.296279:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383139.296304:0:6787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.296316:0:6787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6787:1874206979532032:0@lo:502: 00000020:01000000:0.0:1787383139.296336:0:6787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383139.296343:0:6787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787383139.296350:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.296353:0:6787:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787383139.296357:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383139.296361:0:6787:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1787383139.296384:0:6787:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383139.296386:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383139.296401:0:6787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ffc0cf30000) 00000020:00000080:0.0:1787383139.296421:0:6787:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787383139.296426:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383139.296487:0:6787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787383139.296493:0:6787:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787383139.296504:0:6787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5ce928 00010000:00080000:0.0:1787383139.296532:0:6787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc2761e800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1787383139.296763:0:6787:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787383139.366067:0:6787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787383139.366093:0:6787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787383139.366860:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383139.367330:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383139.367386:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787383139.367448:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787383139.368079:0:6792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383139.368085:0:6792:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787383139.368860:0:6787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383139.370767:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383139.370817:0:6787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787383139.370839:0:6787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5ce92f 00000100:00080000:0.0:1787383139.370849:0:6787:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383139.370854:0:6787:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffc2761e800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383139.370908:0:6787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc05150000 x1874206979532160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383139.370953:0:6787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787383139.370992:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979532160:0@lo:8: 00000020:01000000:0.0:1787383139.371040:0:6787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383139.371044:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.371046:0:6787:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787383139.371049:0:6787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383139.371052:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.371054:0:6787:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787383139.371056:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787383139.371058:0:6787:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787383139.371068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.371081:0:6787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6787:1874206979532288:0@lo:502: 00000100:00100000:0.0:1787383139.371121:0:6787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383139.371148:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532160 00000100:00100000:0.0:1787383139.371149:0:6787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.371164:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532288 00000100:00100000:0.0:1787383139.371168:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532288 00000100:00100000:0.0:1787383139.371209:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787383139.371217:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:6787:x1874206979532288:12345-0@lo:502: 00000100:00100000:3.0:1787383139.371405:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532160 00000100:00100000:3.0:1787383139.371431:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383139.371436:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1874206979532160:12345-0@lo:8: 00000100:00100000:0.0:1787383139.371454:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:6787:x1874206979532288:12345-0@lo:502: Request processed in 238us (331us total) trans 0 rc 0/0 00010000:00080000:3.0:1787383139.371456:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000100:00100000:0.0:1787383139.371462:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000020:00000080:3.0:1787383139.371500:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5ce936 00000100:00100000:0.0:1787383139.371517:0:6787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6787:1874206979532288:0@lo:502: 00000020:01000000:0.0:1787383139.371543:0:6787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00002000:00100000:3.0:1787383139.371546:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ffc3fcb6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:00000080:0.0:1787383139.371546:0:6787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.371548:0:6787:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00002000:00080000:3.0:1787383139.371551:0:6599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000040:00080000:0.0:1787383139.371552:0:6787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000001:00000004:3.0:1787383139.371554:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787383139.371681:0:6599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383139.371819:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787383139.371846:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383139.371901:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874206979532160:12345-0@lo:8: Request processed in 463us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383139.371908:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383139.371948:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05150000 x1874206979532160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383139.371958:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383139.371965:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787383139.371971:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383139.371976:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787383139.371978:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc2761e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787383139.371987:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787383139.371991:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979532160:0@lo:8: 00000004:00080000:3.0:1787383139.372008:0:6792:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787383139.372095:0:6792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 163586226131ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787383139.372890:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979532416:0@lo:400: 00000100:00100000:1.0:1787383139.372938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383139.372988:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979532544:0@lo:400: 00000100:00100000:1.0:1787383139.373013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787383139.373481:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787383139.373507:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787383139.373518:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.373541:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383139.373550:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383139.373554:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc2750b800 from 1 10000000:01000000:0.0:1787383139.373556:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383139.373582:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.373590:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.373600:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.373613:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532672:0@lo:101: 00000100:00100000:0.0:1787383139.373648:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.373681:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.374091:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532672 00000100:00100000:1.0:1787383139.374103:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532672 00000100:00100000:0.0:1787383139.379725:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532416 00000100:00100000:0.0:1787383139.379740:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532416 00000100:00100000:0.0:1787383139.379787:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532544 00000100:00100000:0.0:1787383139.379790:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532544 00000100:00100000:0.0:1787383139.379822:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383139.379833:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979532416:12345-0@lo:400: 00000100:00100000:0.0:1787383139.379965:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979532416:12345-0@lo:400: Request processed in 134us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.379973:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383139.379989:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383139.380007:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979532544:12345-0@lo:400: 00000100:00080000:2.0:1787383139.380042:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383139.380042:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979532544:12345-0@lo:400: Request processed in 37us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.380048:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787383139.380119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d710e00 x1874206979532416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.380144:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979532416:0@lo:400: 00010000:00080000:0.0:1787383139.380189:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d712300 x1874206979532544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.380199:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979532544:0@lo:400: 00000100:00100000:0.0:1787383139.382059:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383139.382075:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979532672:12345-0@lo:101: 00010000:00010000:0.0:1787383139.382091:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383139.382108:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce93d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.382151:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce93d expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.382162:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce93d expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.382172:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047800, rc 0) 00000100:00100000:0.0:1787383139.382230:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979532672:12345-0@lo:101: Request processed in 160us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.382238:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383139.382973:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532672:0@lo:101: 00010000:00010000:2.0:1787383139.382993:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383139.383004:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383139.383075:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532800:0@lo:501: 00000100:00100000:2.0:1787383139.383114:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383139.383170:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc03ec8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.383812:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532800 00000100:00100000:1.0:1787383139.383821:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532800 00000100:00100000:1.0:1787383139.383921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383139.383931:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979532800:12345-0@lo:501: 00000100:00100000:1.0:1787383139.384179:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979532800:12345-0@lo:501: Request processed in 249us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.384188:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787383139.385211:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532800:0@lo:501: 00000100:00100000:3.0:1787383139.385262:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532928:0@lo:503: 00000100:00100000:3.0:1787383139.385504:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383139.385548:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.385607:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979532928 00000100:00100000:0.0:1787383139.385614:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979532928 00000100:00100000:0.0:1787383139.385667:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383139.385676:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979532928:12345-0@lo:503: 00000100:00100000:0.0:1787383139.386012:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979532928:12345-0@lo:503: Request processed in 336us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.386020:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787383139.386028:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979532928:0@lo:503: 00000100:00100000:0.0:1787383139.386306:0:6794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6794:1874206979533056:0@lo:502: 00000100:00100000:0.0:1787383139.386342:0:6794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.386409:0:6794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.386620:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533056 00000100:00100000:1.0:1787383139.386626:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533056 00000100:00100000:1.0:1787383139.386661:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383139.386669:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:6794:x1874206979533056:12345-0@lo:502: 00000100:00100000:1.0:1787383139.386951:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:6794:x1874206979533056:12345-0@lo:502: Request processed in 282us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.386958:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383139.387368:0:6794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6794:1874206979533056:0@lo:502: 00000020:01000000:0.0:1787383139.387398:0:6794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383139.387407:0:6794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.387410:0:6794:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383139.392438:0:6794:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc2750b800 00000020:00000080:0.0:1787383139.392445:0:6794:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383139.392500:0:6794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6794:1874206979533184:0@lo:502: 00000100:00100000:0.0:1787383139.392653:0:6794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.392693:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533184 00000100:00100000:0.0:1787383139.392700:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533184 00000100:00100000:0.0:1787383139.392744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383139.392752:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:6794:x1874206979533184:12345-0@lo:502: 00000100:00100000:0.0:1787383139.392974:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:6794:x1874206979533184:12345-0@lo:502: Request processed in 220us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.392982:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383139.393036:0:6794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.393058:0:6794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:6794:1874206979533184:0@lo:502: 00000020:01000000:0.0:1787383139.393095:0:6794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383139.393100:0:6794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383139.393102:0:6794:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787383139.393106:0:6794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787383139.393177:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787383139.393198:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383139.393208:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393220:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383139.393243:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787383139.393246:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffc173ecd40 from 1 10000000:01000000:0.0:1787383139.393249:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787383139.393277:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393285:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393294:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.393306:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979533312:0@lo:101: 00000100:00100000:0.0:1787383139.393337:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.393355:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.393369:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533312 00000100:00100000:0.0:1787383139.393372:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533312 00000100:00100000:0.0:1787383139.393395:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383139.393402:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979533312:12345-0@lo:101: 00010000:00010000:0.0:1787383139.393418:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383139.393431:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce94b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393725:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393741:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393751:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383139.393784:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979533312:12345-0@lo:101: Request processed in 382us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.393790:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383139.393823:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979533312:0@lo:101: 00010000:00010000:0.0:1787383139.393835:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.393844:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383139.393902:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979533440:0@lo:501: 00000100:00100000:0.0:1787383139.393927:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.393946:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383139.393958:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533440 00000100:00100000:0.0:1787383139.393962:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533440 00000100:00100000:0.0:1787383139.393983:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383139.393991:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979533440:12345-0@lo:501: 00000100:00100000:0.0:1787383139.394199:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979533440:12345-0@lo:501: Request processed in 208us (271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383139.394206:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383139.394233:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979533440:0@lo:501: 10000000:01000000:0.0:1787383139.394252:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383139.394258:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383139.394266:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383139.399608:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787383139.458654:0:6793:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787383139.458688:0:6793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533696:0@lo:7: 00000100:00100000:0.0:1787383139.458764:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.458838:0:6793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.458911:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979533568:0@lo:13: 00000100:00100000:1.0:1787383139.458946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383139.460161:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533696 00000100:00100000:2.0:1787383139.460175:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533696 00000100:00100000:2.0:1787383139.460240:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383139.460250:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6793:x1874206979533696:12345-0@lo:7: 00000100:00080000:2.0:1787383139.467903:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383139.469991:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533568 00000100:00100000:0.0:1787383139.470005:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533568 00000100:00100000:0.0:1787383139.470072:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383139.470084:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979533568:12345-0@lo:13: 00002000:00000024:0.0:1787383139.470133:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787383139.470225:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979533568:12345-0@lo:13: Request processed in 144us (11277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383139.470233:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787383139.473246:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05153b80 x1874206979533568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.473272:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979533568:0@lo:13: 00002000:00080000:2.0:1787383139.474516:0:6601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787383139.474524:0:6601:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787383139.474634:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6793:x1874206979533696:12345-0@lo:7: Request processed in 14382us (15866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383139.474644:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787383139.474813:0:6793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05151500 x1874206979533696/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.474826:0:6793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533696:0@lo:7: 00000004:00080000:0.0:1787383139.474838:0:6793:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787383139.474908:0:6793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533824:0@lo:5: 00000100:00100000:0.0:1787383139.474946:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.475118:0:6793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383139.475209:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533824 00000100:00100000:3.0:1787383139.475218:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533824 00000100:00100000:3.0:1787383139.475260:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383139.475270:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6793:x1874206979533824:12345-0@lo:5: 00002000:00080000:3.0:1787383139.475300:0:6600:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787383139.475304:0:6600:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787383139.475588:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6793:x1874206979533824:12345-0@lo:5: Request processed in 319us (641us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787383139.475595:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383139.475670:0:6793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05151500 x1874206979533824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.475683:0:6793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533824:0@lo:5: 00000004:00080000:0.0:1787383139.475693:0:6793:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787383139.475719:0:6793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533952:0@lo:700: 00000100:00100000:0.0:1787383139.475745:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383139.475770:0:6793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09847180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383139.476298:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979533952 00000100:00100000:3.0:1787383139.476303:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979533952 00000100:00100000:3.0:1787383139.476340:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383139.476349:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6793:x1874206979533952:12345-0@lo:700: 00000100:00100000:3.0:1787383139.476384:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6607:1874206979534080:0@lo:700: 00000100:00100000:3.0:1787383139.476420:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383139.476524:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383139.476567:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534080 00000100:00100000:1.0:1787383139.476572:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534080 00000100:00100000:1.0:1787383139.476647:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383139.476655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6607:x1874206979534080:12345-0@lo:700: 40000000:02000000:0.0:1787383139.503056:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787383139.512601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6607:x1874206979534080:12345-0@lo:700: Request processed in 35939us (36171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383139.512615:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383139.512760:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d7e1180 x1874206979534080/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787383155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383139.512778:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6607:1874206979534080:0@lo:700: 40000000:02000000:3.0:1787383139.512791:0:6607:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1787383139.617472:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6793:x1874206979533952:12345-0@lo:700: Request processed in 141114us (141715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383139.617494:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1787383139.617545:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787383139.617554:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787383139.620959:0:6793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05151f80 x1874206979533952/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383139.620982:0:6793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979533952:0@lo:700: 00000004:02000040:1.0:1787383139.698116:0:6793:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787383139.705518:0:6793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979534208:0@lo:5: 00000100:00100000:1.0:1787383139.705590:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383139.705772:0:6793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383139.705818:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534208 00000100:00100000:2.0:1787383139.705826:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534208 00000100:00100000:2.0:1787383139.706270:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383139.706290:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6793:x1874206979534208:12345-0@lo:5: 00002000:00080000:3.0:1787383139.713584:0:6601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787383139.713606:0:6601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787383139.717027:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6793:x1874206979534208:12345-0@lo:5: Request processed in 10730us (11427us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787383139.717042:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787383139.717170:0:6793:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d711880 x1874206979534208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383139.717185:0:6793:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787383139.717202:0:6793:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffc2d711880 x1874206979534208/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383155 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383139.717214:0:6793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6793:1874206979534208:0@lo:5: 00000004:00080000:1.0:1787383139.717229:0:6793:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787383140.172503:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383141.194362:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.221560:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383142.378735:0:6969:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787383143.242993:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383144.267057:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383144.714481:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979534720:0@lo:400: 00000100:00100000:3.0:1787383144.714715:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979534464:0@lo:400: 00000100:00100000:3.0:1787383144.714762:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383144.714815:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383144.714821:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979534592:0@lo:400: 00000100:00100000:3.0:1787383144.716263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383144.716355:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534464 00000100:00100000:3.0:1787383144.716363:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534464 00000100:00100000:3.0:1787383144.716436:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534592 00000100:00100000:3.0:1787383144.716439:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534592 00000100:00100000:3.0:1787383144.716467:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383144.716474:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979534464:12345-0@lo:400: 00000100:00100000:3.0:1787383144.716524:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979534464:12345-0@lo:400: Request processed in 49us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383144.716530:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383144.716546:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383144.716551:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979534592:12345-0@lo:400: 00000100:00100000:3.0:1787383144.716573:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979534592:12345-0@lo:400: Request processed in 22us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383144.716577:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787383144.716610:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05151180 x1874206979534592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383144.716623:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979534592:0@lo:400: 00010000:00080000:3.0:1787383144.716632:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05151880 x1874206979534464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383144.716639:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979534464:0@lo:400: 00000100:00100000:0.0:1787383144.716893:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383144.716934:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787383144.716996:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979534336:0@lo:400: 00000100:00100000:0.0:1787383144.717041:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383144.717069:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979534848:0@lo:13: 00000100:00100000:0.0:1787383144.717114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383144.717140:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534336 00000100:00100000:0.0:1787383144.717143:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534336 00000100:00100000:0.0:1787383144.717173:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383144.717180:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3314:x1874206979534336:12345-0@lo:400: 00000100:00100000:0.0:1787383144.717213:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3314:x1874206979534336:12345-0@lo:400: Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383144.717219:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383144.717245:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534848 00000100:00100000:0.0:1787383144.717248:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534848 00000100:00100000:0.0:1787383144.717275:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383144.717281:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979534848:12345-0@lo:13: 00002000:00000024:0.0:1787383144.717319:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383144.717345:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979534848:12345-0@lo:13: Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383144.717350:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383144.717376:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979534336:0@lo:400: 00010000:00080000:0.0:1787383144.717386:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d7e1180 x1874206979534848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383144.717398:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979534848:0@lo:13: 00000100:00080000:2.0:1787383144.717530:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383144.717535:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383144.724127:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534720 00000100:00100000:3.0:1787383144.724143:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534720 00000100:00100000:3.0:1787383144.724246:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383144.724256:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979534720:12345-0@lo:400: 00000100:00100000:3.0:1787383144.724349:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979534720:12345-0@lo:400: Request processed in 95us (9768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383144.724364:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383144.727791:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc05153480 x1874206979534720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383144.727810:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979534720:0@lo:400: 00000001:00080000:2.0:1787383144.807013:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787383145.292238:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383146.327338:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383147.339068:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383148.362962:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383149.385970:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383149.835092:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979534976:0@lo:13: 00000100:00100000:0.0:1787383149.835167:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383149.835442:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979535360:0@lo:400: 00000100:00100000:2.0:1787383149.835496:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383149.835516:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383149.835534:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979535232:0@lo:400: 00000100:00100000:2.0:1787383149.835558:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383149.835599:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535360 00000100:00100000:2.0:1787383149.835606:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535360 00000100:00100000:2.0:1787383149.835652:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535232 00000100:00100000:2.0:1787383149.835656:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535232 00000100:00100000:2.0:1787383149.835671:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383149.835679:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979535360:12345-0@lo:400: 00000100:00100000:2.0:1787383149.835729:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979535360:12345-0@lo:400: Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383149.835735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383149.835753:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383149.835759:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979535232:12345-0@lo:400: 00000100:00100000:2.0:1787383149.835783:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979535232:12345-0@lo:400: Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383149.835796:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787383149.835816:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383149.835829:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979535104:0@lo:400: 00000100:00100000:2.0:1787383149.835862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383149.835915:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535104 00000100:00100000:2.0:1787383149.835918:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535104 00000100:00100000:2.0:1787383149.835944:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383149.835950:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3313:x1874206979535104:12345-0@lo:400: 00000100:00100000:2.0:1787383149.835988:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3313:x1874206979535104:12345-0@lo:400: Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383149.835995:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383149.836045:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979535104:0@lo:400: 00010000:00080000:2.0:1787383149.836077:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d710e00 x1874206979535232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383149.836088:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979535232:0@lo:400: 00010000:00080000:2.0:1787383149.836097:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d711f80 x1874206979535360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383149.836106:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979535360:0@lo:400: 00000100:00100000:0.0:1787383149.836689:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979534976 00000100:00100000:0.0:1787383149.836695:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979534976 00000100:00100000:0.0:1787383149.836745:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383149.836761:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979534976:12345-0@lo:13: 00002000:00000024:0.0:1787383149.836790:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383149.836828:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979534976:12345-0@lo:13: Request processed in 69us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383149.836835:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383149.836863:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d7e2a00 x1874206979534976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383149.836892:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787383149.836909:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979534976:0@lo:13: 00000100:00080000:2.0:1787383149.836991:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787383150.410080:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383151.435062:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383152.457968:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383152.491984:0:7488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383152.491987:0:7488:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787383152.492153:0:7488:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ffc3ff86800 00000020:01000004:1.0:1787383152.492168:0:7488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787383152.492182:0:7488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787383152.492196:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ffc170999c0) 00000020:00000080:1.0:1787383152.492211:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787383152.500743:0:7488:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787383152.500980:0:7488:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787383152.515252:0:7488:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787383152.519495:0:7488:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787383152.519528:0:7488:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787383152.519584:0:7488:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787383152.519613:0:7488:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787383152.520029:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787383152.520042:0:7488:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787383152.520052:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42020b050d5ce960 00000020:01000004:0.0:1787383152.520059:0:7488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787383152.520082:0:7488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787383152.520086:0:7488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787383152.520092:0:7488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787383152.520113:0:7488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787383152.520117:0:7488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787383152.535577:0:7488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787383152.535617:0:7488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787383152.535622:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787383152.535623:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787383152.535625:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383152.535629:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383152.535631:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383152.535632:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383152.535634:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383152.535635:0:7488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383152.535636:0:7488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383152.535638:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383152.535639:0:7488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383152.535643:0:7488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787383152.535645:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383152.535646:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787383152.535647:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383152.535648:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383152.535649:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383152.535650:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383152.535650:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383152.535651:0:7488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383152.535652:0:7488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383152.535653:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383152.535654:0:7488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383152.535689:0:7488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787383152.535711:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979535488:0@lo:253: 00000100:00100000:0.0:1787383152.535788:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383152.535985:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.536049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535488 00000100:00100000:2.0:1787383152.536058:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535488 00000100:00100000:2.0:1787383152.536142:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383152.536152:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:7488:x1874206979535488:12345-0@lo:253: 20000000:01000000:2.0:1787383152.536191:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787383152.536196:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787383152.536200:0:5797:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787383152.536203:0:5797:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787383152.537125:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383152.537346:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787383152.537362:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787383152.537403:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787383152.537411:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787383152.537442:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787383152.537492:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787383152.537928:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787383152.537948:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:2.0:1787383152.537950:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:2.0:1787383152.537985:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787383152.537993:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787383152.538057:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787383152.538066:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:2.0:1787383152.538098:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787383152.538107:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787383152.538138:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787383152.538188:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787383152.538902:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787383152.538921:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:2.0:1787383152.538923:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:2.0:1787383152.538956:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787383152.538963:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787383152.539209:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787383152.539218:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:2.0:1787383152.539255:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787383152.539264:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787383152.539324:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787383152.539520:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787383152.539540:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787383152.539543:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787383152.539546:0:5797:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787383152.539559:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787383152.539562:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787383152.539597:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787383152.539600:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787383152.540300:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787383152.540354:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787383152.540407:0:7490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787383152.540808:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787383152.540853:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787383152.541028:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787383152.541043:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787383152.541046:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787383152.541445:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787383152.541485:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787383152.541529:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787383152.541800:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787383152.541838:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787383152.541991:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787383152.542015:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787383152.542017:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787383152.542345:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787383152.542536:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787383152.542574:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787383152.542628:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787383152.542642:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787383152.542644:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787383152.543385:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787383152.543475:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787383152.543510:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787383152.543843:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787383152.544085:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787383152.544141:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787383152.544158:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787383152.544161:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787383152.544178:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787383152.544201:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544218:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544224:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544229:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544235:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce913 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544241:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544249:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544290:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544306:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.544322:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535616:0@lo:104: 00000100:00100000:2.0:1787383152.544388:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383152.544498:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544516:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 16 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.544525:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535744:0@lo:104: 00010000:00010000:2.0:1787383152.544552:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544560:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 16 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.544568:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535872:0@lo:104: 00010000:00010000:2.0:1787383152.544590:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544598:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 16 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.544607:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979536000:0@lo:104: 00010000:00010000:2.0:1787383152.544630:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.544638:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 16 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.544646:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979536128:0@lo:104: 00000100:00100000:2.0:1787383152.544662:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.545082:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787383152.545104:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.545177:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.545238:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.545258:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535616 00000100:00100000:1.0:1787383152.545265:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535616 00000100:00100000:1.0:1787383152.545300:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535744 00000100:00100000:1.0:1787383152.545304:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535744 00000100:00100000:1.0:1787383152.545315:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979535872 00000100:00100000:1.0:1787383152.545317:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979535872 00000100:00100000:1.0:1787383152.545331:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383152.545341:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc10f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5797:x1874206979535616:12345-0@lo:104: 00010000:00010000:1.0:1787383152.545353:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.545468:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383152.545474:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc10f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:5797:x1874206979535616:12345-0@lo:104: Request processed in 135us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383152.545492:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383152.545550:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383152.545557:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979535744:12345-0@lo:104: 00010000:00010000:1.0:1787383152.545565:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.545602:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383152.545607:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979535744:12345-0@lo:104: Request processed in 52us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383152.545613:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383152.545626:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383152.545632:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979535872:12345-0@lo:104: 00010000:00010000:1.0:1787383152.545640:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.545664:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787383152.545669:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979535872:12345-0@lo:104: Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383152.545674:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787383152.545734:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787383152.545741:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545754:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383152.545759:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545767:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383152.545774:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383152.545779:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383152.545815:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545822:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383152.545841:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545848:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046800/0x42020b050d5ce94b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce952 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545859:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383152.545862:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545891:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046000 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383152.545894:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545911:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383152.545917:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383152.545922:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383152.545936:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545942:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383152.545948:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545955:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046000/0x42020b050d5ce913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce91a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545964:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383152.545967:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545973:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411600 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383152.545975:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.545982:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383152.545988:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383152.546000:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383152.546027:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546034:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383152.546050:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411600/0x42020b050d5ce8f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8fe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546068:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383152.546069:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383152.546071:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383152.546085:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979536256:0@lo:103: 00000100:00100000:0.0:1787383152.546119:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383152.546151:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383152.546157:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979536384:0@lo:103: 00000100:00100000:0.0:1787383152.546176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383152.546202:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536256 00000100:00100000:0.0:1787383152.546207:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536256 00010000:00010000:0.0:1787383152.546227:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 17 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383152.546246:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536384 00000100:00100000:0.0:1787383152.546249:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536384 00010000:00010000:0.0:1787383152.546258:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 18 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383152.546284:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383152.546291:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3312:x1874206979536256:12345-0@lo:103: 00010000:00010000:0.0:1787383152.546301:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383152.546306:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 18 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546317:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 18 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546334:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383152.546361:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3312:x1874206979536256:12345-0@lo:103: Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.546367:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383152.546379:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383152.546385:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3312:x1874206979536384:12345-0@lo:103: 00010000:00010000:0.0:1787383152.546393:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383152.546397:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 17 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546405:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 17 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.546414:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383152.546432:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3312:x1874206979536384:12345-0@lo:103: Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.546437:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383152.546468:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979536384:0@lo:103: 00000100:00100000:0.0:1787383152.546482:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979536256:0@lo:103: 00000100:00100000:3.0:1787383152.546688:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.546699:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536000 00000100:00100000:3.0:1787383152.546702:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536000 00000100:00100000:3.0:1787383152.546733:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536128 00000100:00100000:3.0:1787383152.546737:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536128 00000100:00100000:3.0:1787383152.546751:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383152.546758:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979536000:12345-0@lo:104: 00010000:00010000:3.0:1787383152.546766:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.546807:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383152.546812:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:5797:x1874206979536000:12345-0@lo:104: Request processed in 56us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.546818:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383152.546831:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383152.546838:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979536128:12345-0@lo:104: 00010000:00010000:3.0:1787383152.546845:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.546901:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383152.546906:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5797:x1874206979536128:12345-0@lo:104: Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.546912:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383152.546946:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979536512:0@lo:103: 00000100:00100000:3.0:1787383152.546969:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.546995:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536512 00000100:00100000:3.0:1787383152.546998:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536512 00010000:00010000:3.0:1787383152.547045:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 17 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383152.547065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383152.547071:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3314:x1874206979536512:12345-0@lo:103: 00010000:00010000:3.0:1787383152.547079:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383152.547082:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 17 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547091:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 17 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547102:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383152.547126:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3314:x1874206979536512:12345-0@lo:103: Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.547131:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383152.547155:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979536512:0@lo:103: 00010000:00010000:3.0:1787383152.547192:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383152.547199:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547214:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046e00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383152.547217:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547223:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383152.547230:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383152.547235:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383152.547257:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547263:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383152.547272:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547279:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce8cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8d4 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547290:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383152.547293:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547299:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01410600 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383152.547302:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547318:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383152.547324:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383152.547330:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383152.547344:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547350:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383152.547361:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547368:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01410600/0x42020b050d5ce8a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8aa expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547383:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383152.547385:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383152.547387:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383152.547393:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383152.547400:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979536640:0@lo:103: 00000100:00100000:3.0:1787383152.547423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.547443:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383152.547451:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979536768:0@lo:103: 00000100:00100000:3.0:1787383152.547472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.547495:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536640 00000100:00100000:3.0:1787383152.547498:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536640 00010000:00010000:3.0:1787383152.547512:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 17 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383152.547532:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536768 00000100:00100000:3.0:1787383152.547535:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536768 00010000:00010000:3.0:1787383152.547547:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 18 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383152.547559:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383152.547565:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3314:x1874206979536640:12345-0@lo:103: 00010000:00010000:3.0:1787383152.547571:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383152.547575:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 18 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547583:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 18 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547593:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383152.547620:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3314:x1874206979536640:12345-0@lo:103: Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.547626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383152.547638:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383152.547645:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3313:x1874206979536768:12345-0@lo:103: 00010000:00010000:3.0:1787383152.547652:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383152.547656:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 17 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547666:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 17 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547677:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547690:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547705:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547712:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547719:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547724:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547729:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383152.547733:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547740:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547747:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.547757:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383152.547784:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3313:x1874206979536768:12345-0@lo:103: Request processed in 140us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.547791:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383152.547817:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979536640:0@lo:103: 00000100:00100000:3.0:1787383152.547846:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979536768:0@lo:103: 00010000:00010000:0.0:1787383152.548142:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383152.548247:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046600/0x42020b050d5ce952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce94b expref: 16 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.548269:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535616:0@lo:104: 00010000:00010000:2.0:1787383152.548284:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046200/0x42020b050d5ce91a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce913 expref: 15 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.548291:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535744:0@lo:104: 00010000:00010000:2.0:1787383152.548301:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ce8fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce8f7 expref: 14 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.548308:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979535872:0@lo:104: 00010000:00010000:2.0:1787383152.548316:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01663a00/0x42020b050d5ce8d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce8cd expref: 13 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.548326:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979536000:0@lo:104: 00010000:00010000:2.0:1787383152.548336:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01662400/0x42020b050d5ce8aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce8a3 expref: 12 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.548346:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1874206979536128:0@lo:104: 00010000:00010000:2.0:1787383152.548365:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.548374:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.548380:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.548387:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515c00/0x42020b050d5ce967 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787383152.548406:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787383152.592897:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:7488:x1874206979535488:12345-0@lo:253: Request processed in 56707us (57069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.592913:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383152.593201:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979535488:0@lo:253: 10000000:01000000:2.0:1787383152.593219:0:7488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787383152.593222:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383152.593224:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383152.593225:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383152.593227:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787383152.593228:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383152.593229:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383152.593231:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383152.593232:0:7488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787383152.593234:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383152.593235:0:7488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787383152.593256:0:7488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffc3ff86800 from lustre-OST0001 10000000:01000000:2.0:1787383152.593284:0:7488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787383152.593287:0:7488:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787383152.593294:0:7488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffc173ecd40 local copy 10000000:01000000:2.0:1787383152.593299:0:7488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787383152.593335:0:7488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.593348:0:7488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.593357:0:7488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.593377:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979536896:0@lo:101: 00000100:00100000:2.0:1787383152.593416:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.593467:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.593548:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979536896 00000100:00100000:3.0:1787383152.593555:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979536896 00000100:00100000:3.0:1787383152.593608:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383152.593617:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:7488:x1874206979536896:12345-0@lo:101: 00010000:00010000:3.0:1787383152.593630:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383152.593643:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce96e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.593665:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce96e expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.593676:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce96e expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.593685:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01663c00, rc 0) 00000100:00100000:3.0:1787383152.593725:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979536896:12345-0@lo:101: Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.593730:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383152.593805:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979536896:0@lo:101: 00010000:00010000:1.0:1787383152.593818:0:7488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.593827:0:7488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383152.593953:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537024:0@lo:501: 00000100:00100000:1.0:1787383152.593994:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.594023:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.594137:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537024 00000100:00100000:2.0:1787383152.594147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537024 00000100:00100000:2.0:1787383152.594181:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787383152.594187:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537024:12345-0@lo:501: 00000100:00100000:2.0:1787383152.594387:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537024:12345-0@lo:501: Request processed in 199us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383152.594395:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383152.594481:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537024:0@lo:501: 10000000:01000000:1.0:1787383152.594494:0:7488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383152.594519:0:7488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383152.594525:0:7488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.594534:0:7488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.594541:0:7488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.594563:0:7488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787383152.594591:0:7488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffc3ff86800 10000000:01000000:1.0:1787383152.594596:0:7488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383152.594600:0:7488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787383152.594603:0:7488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383152.594607:0:7488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787383152.594609:0:7488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383152.594627:0:7488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.594634:0:7488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.594642:0:7488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383152.594663:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537152:0@lo:101: 00000100:00100000:1.0:1787383152.594690:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.594702:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501d780 going to sleep for 11 seconds 00010000:00010000:2.0:1787383152.594809:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383152.594816:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.594823:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383152.594826:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.594834:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383152.594841:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383152.594846:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383152.594863:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.594899:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383152.594916:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.594921:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce96e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42020b050d5ce975 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.594942:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383152.594944:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383152.594946:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383152.594953:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383152.594963:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979537280:0@lo:103: 00000100:00100000:2.0:1787383152.594988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.595031:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537280 00000100:00100000:2.0:1787383152.595035:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537280 00000100:00100000:2.0:1787383152.595066:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383152.595073:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:3312:x1874206979537280:12345-0@lo:103: 00010000:00010000:2.0:1787383152.595083:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383152.595095:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ce96e expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.595110:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383152.595136:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:3312:x1874206979537280:12345-0@lo:103: Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.595142:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383152.595172:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979537280:0@lo:103: 00000100:00100000:2.0:1787383152.595187:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537152 00000100:00100000:2.0:1787383152.595190:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537152 00000100:00100000:2.0:1787383152.595210:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383152.595216:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+11:7488:x1874206979537152:12345-0@lo:101: 00010000:00010000:2.0:1787383152.595223:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383152.595233:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce97c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.595260:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce97c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.595269:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce97c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.595276:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515200, rc 0) 00000100:00100000:2.0:1787383152.595302:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537152:12345-0@lo:101: Request processed in 86us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.595308:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383152.595439:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537152:0@lo:101: 00010000:00010000:1.0:1787383152.595449:0:7488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.595457:0:7488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383152.595525:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537408:0@lo:501: 00000100:00100000:1.0:1787383152.595550:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.595568:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.595675:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537408 00000100:00100000:2.0:1787383152.595679:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537408 00000100:00100000:2.0:1787383152.595708:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383152.595715:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537408:12345-0@lo:501: 00000100:00100000:3.0:1787383152.596217:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537408:12345-0@lo:501: Request processed in 500us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.596225:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383152.596298:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537408:0@lo:501: 00000100:00100000:1.0:1787383152.596331:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537536:0@lo:503: 00000100:00100000:1.0:1787383152.596372:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.596404:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.596453:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537536 00000100:00100000:3.0:1787383152.596457:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537536 00000100:00100000:3.0:1787383152.596486:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787383152.596499:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537536:12345-0@lo:503: 00000100:00100000:3.0:1787383152.596660:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537536:12345-0@lo:503: Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.596667:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383152.596744:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537536:0@lo:503: 00000040:00080000:2.0:1787383152.597056:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383152.597120:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537664:0@lo:502: 00000100:00100000:2.0:1787383152.597162:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.597181:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.597234:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537664 00000100:00100000:3.0:1787383152.597238:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537664 00000100:00100000:3.0:1787383152.597269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383152.597276:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537664:12345-0@lo:502: 00000100:00100000:3.0:1787383152.597400:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537664:12345-0@lo:502: Request processed in 124us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.597407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383152.597485:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537664:0@lo:502: 00000040:00080000:2.0:1787383152.597726:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787383152.597773:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787383152.597809:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787383152.597852:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787383152.597921:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787383152.597954:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787383152.597986:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537792:0@lo:502: 00000100:00100000:2.0:1787383152.598036:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.598054:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.598070:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537792 00000100:00100000:2.0:1787383152.598074:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537792 00000100:00100000:2.0:1787383152.598094:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787383152.598100:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537792:12345-0@lo:502: 00000100:00100000:2.0:1787383152.598228:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537792:12345-0@lo:502: Request processed in 128us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.598235:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787383152.598273:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537792:0@lo:502: 00000040:00080000:2.0:1787383152.598341:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787383152.598349:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787383152.599177:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383152.599186:0:7495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787383152.599192:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383152.599194:0:7495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787383152.599201:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383152.599214:0:7495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ffc1709b380) 00000020:00000080:1.0:1787383152.599233:0:7495:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787383152.599239:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787383152.599310:0:7495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc3ff86800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787383152.599318:0:7495:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383152.599331:0:7495:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42020b050d5ce991 00010000:00010000:1.0:1787383152.603168:0:7495:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787383152.603512:0:7495:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787383152.606309:0:7495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787383152.606598:0:7495:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787383152.610376:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787383152.611201:0:7495:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787383152.612442:0:7495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787383152.612454:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383152.612462:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383152.612464:0:7495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787383152.612468:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383152.612472:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383152.612474:0:7495:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383152.612477:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383152.612479:0:7495:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787383152.612527:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383152.612531:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383152.612532:0:7495:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383152.612536:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787383152.612757:0:7488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787383152.612785:0:7488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787383152.612807:0:7488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.612820:0:7488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383152.612829:0:7488:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3ff86800 from 1 10000000:01000000:3.0:1787383152.612832:0:7488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383152.612900:0:7488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.612909:0:7488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.612920:0:7488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383152.612957:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537920:0@lo:101: 00000100:00100000:3.0:1787383152.613046:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.613086:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383152.613205:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979537920 00000100:00100000:0.0:1787383152.613213:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979537920 00000100:00100000:0.0:1787383152.613252:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787383152.613261:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:7488:x1874206979537920:12345-0@lo:101: 00010000:00010000:0.0:1787383152.613275:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383152.613287:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce998 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.613310:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce998 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.613321:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce998 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.613332:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046000, rc 0) 00000100:00100000:0.0:1787383152.613371:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979537920:12345-0@lo:101: Request processed in 111us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.613378:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383152.613472:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979537920:0@lo:101: 00010000:00010000:3.0:1787383152.613486:0:7488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.613495:0:7488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383152.613597:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538048:0@lo:501: 00000100:00100000:3.0:1787383152.613626:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.613652:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383152.613768:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538048 00000100:00100000:0.0:1787383152.613772:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538048 00000100:00100000:0.0:1787383152.613796:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787383152.613803:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538048:12345-0@lo:501: 00000100:00100000:0.0:1787383152.614096:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538048:12345-0@lo:501: Request processed in 293us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.614103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383152.616039:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538048:0@lo:501: 00000100:00100000:3.0:1787383152.616095:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538176:0@lo:503: 00000100:00100000:3.0:1787383152.616159:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.618938:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383152.620887:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538176 00000100:00100000:0.0:1787383152.620913:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538176 00000100:00100000:0.0:1787383152.621077:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787383152.621089:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538176:12345-0@lo:503: 00000100:00100000:0.0:1787383152.621478:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538176:12345-0@lo:503: Request processed in 390us (5317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.621487:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787383152.621592:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538176:0@lo:503: 00000040:00080000:2.0:1787383152.621897:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383152.621969:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538304:0@lo:502: 00000100:00100000:2.0:1787383152.622028:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.623188:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.625517:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538304 00000100:00100000:3.0:1787383152.625531:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538304 00000100:00100000:3.0:1787383152.625592:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383152.625604:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538304:12345-0@lo:502: 00000100:00100000:3.0:1787383152.625942:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538304:12345-0@lo:502: Request processed in 340us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.625951:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383152.626235:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538304:0@lo:502: 00000040:00080000:2.0:1787383152.626552:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787383152.626624:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787383152.626665:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538432:0@lo:502: 00000100:00100000:2.0:1787383152.626713:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.626742:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.626860:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538432 00000100:00100000:3.0:1787383152.626912:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538432 00000100:00100000:3.0:1787383152.626942:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787383152.626950:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538432:12345-0@lo:502: 00000100:00100000:3.0:1787383152.627117:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538432:12345-0@lo:502: Request processed in 168us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.627124:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383152.627331:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538432:0@lo:502: 00000040:00080000:2.0:1787383152.627421:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787383152.627438:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787383152.628200:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383152.628211:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383152.628214:0:7499:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383152.628221:0:7499:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc3ff86800 00000020:00000080:0.0:1787383152.628223:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383152.628242:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383152.628245:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383152.628247:0:7499:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787383152.628249:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787383152.628392:0:7488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787383152.628418:0:7488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383152.628465:0:7488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.628476:0:7488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383152.628514:0:7488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787383152.628517:0:7488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffc3ff86800 10000000:01000000:2.0:1787383152.628520:0:7488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffc3ff86800 10000000:01000000:2.0:1787383152.628524:0:7488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383152.628529:0:7488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc3ff86800 from 1 10000000:01000000:2.0:1787383152.628532:0:7488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383152.628565:0:7488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.628649:0:7488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.628661:0:7488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.628680:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538560:0@lo:101: 00000100:00100000:2.0:1787383152.628731:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.628771:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383152.628826:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538560 00000100:00100000:3.0:1787383152.628832:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538560 00000100:00100000:3.0:1787383152.628895:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787383152.628904:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979538560:12345-0@lo:101: 00010000:00010000:3.0:1787383152.628915:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383152.628927:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce9a6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.628948:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.628960:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383152.628969:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01663800, rc 0) 00000100:00100000:3.0:1787383152.629017:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538560:12345-0@lo:101: Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.629023:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787383152.629154:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538560:0@lo:101: 00010000:00010000:2.0:1787383152.629167:0:7488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.629189:0:7488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.629270:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538688:0@lo:501: 00000100:00100000:2.0:1787383152.629296:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.629320:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383152.629362:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538688 00000100:00100000:0.0:1787383152.629367:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538688 00000100:00100000:0.0:1787383152.629396:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787383152.629403:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538688:12345-0@lo:501: 00000100:00100000:0.0:1787383152.629696:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538688:12345-0@lo:501: Request processed in 293us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.629703:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383152.629768:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538688:0@lo:501: 00000100:00100000:2.0:1787383152.629796:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538816:0@lo:503: 00000100:00100000:2.0:1787383152.629833:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.629854:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383152.629932:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538816 00000100:00100000:0.0:1787383152.629936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538816 00000100:00100000:0.0:1787383152.629965:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787383152.629972:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538816:12345-0@lo:503: 00000100:00100000:0.0:1787383152.630111:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538816:12345-0@lo:503: Request processed in 138us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.630117:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383152.630241:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538816:0@lo:503: 00000040:00080000:2.0:1787383152.630491:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383152.630545:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538944:0@lo:502: 00000100:00100000:2.0:1787383152.630660:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.630693:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.630710:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979538944 00000100:00100000:2.0:1787383152.630713:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979538944 00000100:00100000:2.0:1787383152.630745:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383152.630752:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538944:12345-0@lo:502: 00000100:00100000:2.0:1787383152.630946:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979538944:12345-0@lo:502: Request processed in 193us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.630952:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383152.630990:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979538944:0@lo:502: 00000040:00080000:2.0:1787383152.631250:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787383152.631306:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787383152.631340:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787383152.631382:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787383152.631419:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787383152.631462:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787383152.631495:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787383152.631524:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787383152.631565:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787383152.631930:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787383152.631963:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787383152.632036:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787383152.632072:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787383152.632104:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787383152.632151:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787383152.632187:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787383152.632221:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787383152.632267:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787383152.632302:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787383152.632336:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787383152.632399:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787383152.632437:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787383152.632470:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787383152.632516:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787383152.632554:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787383152.632674:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787383152.632724:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787383152.632758:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787383152.632789:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787383152.632834:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787383152.632896:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787383152.632933:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787383152.632967:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787383152.633044:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787383152.633088:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787383152.633135:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787383152.633169:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787383152.633212:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979539072:0@lo:502: 00000100:00100000:2.0:1787383152.633285:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.633327:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383152.633362:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539072 00000100:00100000:2.0:1787383152.633368:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539072 00000100:00100000:2.0:1787383152.633414:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383152.633423:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979539072:12345-0@lo:502: 00000100:00100000:2.0:1787383152.633898:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979539072:12345-0@lo:502: Request processed in 475us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.633907:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787383152.634141:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979539072:0@lo:502: 00000040:00080000:1.0:1787383152.634302:0:7488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787383152.634315:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787383152.635250:0:7500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787383152.635268:0:7500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ffc3d024d40) 00000020:00000080:2.0:1787383152.635290:0:7500:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787383152.635479:0:7500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc3ff86800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787383152.635484:0:7500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc3ff86800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787383152.635486:0:7500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3ff86800 3 00010000:00080000:2.0:1787383152.635514:0:7500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffb0199c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1787383152.637150:0:7500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787383152.637263:0:7500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787383152.637300:0:7500:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383152.637311:0:7500:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x42020b050d5ce9bb 00000100:00080000:2.0:1787383152.637320:0:7500:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383152.637326:0:7500:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ffb0199c800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1787383152.637364:0:7500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc2d714a80 x1874206979539200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383152.637397:0:7500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787383152.637772:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383152.637788:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979539584:0@lo:400: 00000100:00100000:1.0:1787383152.637857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.637992:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979539200:0@lo:38: 00000100:00100000:3.0:1787383152.638095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.638135:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979539456:0@lo:400: 00000100:00100000:3.0:1787383152.638159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.638186:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383152.638192:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979539328:0@lo:400: 00000100:00100000:3.0:1787383152.638215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383152.638240:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539584 00000100:00100000:3.0:1787383152.638246:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539584 00000100:00100000:3.0:1787383152.638295:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383152.638306:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979539584:12345-0@lo:400: 00000100:00100000:3.0:1787383152.638354:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979539584:12345-0@lo:400: Request processed in 51us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383152.638361:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383152.638397:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d713100 x1874206979539584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383152.638410:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979539584:0@lo:400: 00000100:00100000:2.0:1787383152.638562:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539200 00000100:00100000:2.0:1787383152.638567:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539200 00000100:00100000:2.0:1787383152.638666:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539456 00000100:00100000:2.0:1787383152.638670:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539456 00000100:00100000:2.0:1787383152.638690:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539328 00000100:00100000:2.0:1787383152.638692:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539328 00000100:00100000:2.0:1787383152.638722:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383152.638728:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979539456:12345-0@lo:400: 00000100:00100000:2.0:1787383152.638818:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979539456:12345-0@lo:400: Request processed in 90us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.638824:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383152.638841:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383152.638846:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979539328:12345-0@lo:400: 00000100:00100000:2.0:1787383152.638901:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979539328:12345-0@lo:400: Request processed in 55us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.638907:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383152.638919:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383152.638923:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1874206979539200:12345-0@lo:38: 00010000:00080000:2.0:1787383152.638946:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1787383152.638976:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42020b050d5ce9c2 00000004:00100000:2.0:1787383152.638989:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787383152.639114:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383152.639152:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874206979539200:12345-0@lo:38: Request processed in 227us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.639158:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787383152.639182:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383152.639185:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383152.639207:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d714a80 x1874206979539200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383152.639224:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383152.639230:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787383152.639238:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787383152.639243:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787383152.639245:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383152.639251:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979539200:0@lo:38: 00000040:00080000:2.0:1787383152.639558:0:7500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787383152.639767:0:7488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787383152.639792:0:7488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383152.639815:0:7488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.639827:0:7488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787383152.639899:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787383152.639902:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383152.639903:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383152.639904:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383152.639905:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383152.639907:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383152.639908:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383152.639910:0:7488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383152.639911:0:7488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383152.639913:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383152.639915:0:7488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383152.639918:0:7488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787383152.639921:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383152.639922:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383152.639924:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383152.639925:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383152.639926:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383152.639927:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383152.639928:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383152.639929:0:7488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383152.639930:0:7488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383152.639932:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383152.639932:0:7488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383152.639951:0:7488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787383152.639965:0:7488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979539712:0@lo:253: 00000100:00100000:1.0:1787383152.640017:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.640045:0:7488:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383152.640064:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539712 00000100:00100000:1.0:1787383152.640069:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539712 00000100:00100000:1.0:1787383152.640101:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383152.640108:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7488:x1874206979539712:12345-0@lo:253: 20000000:01000000:1.0:1787383152.640130:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787383152.640146:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787383152.642658:0:7501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1874206979539840:0@lo:901: 00000100:00100000:1.0:1787383152.642824:0:7501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383152.642865:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539840 00000100:00100000:1.0:1787383152.642886:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539840 00000100:00100000:1.0:1787383152.642960:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383152.642968:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1874206979539840:12345-0@lo:901: 00000100:00100000:1.0:1787383152.643303:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1874206979539840:12345-0@lo:901: Request processed in 334us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383152.643312:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383152.643335:0:7501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501dc00 going to sleep for 11 seconds 00010000:00080000:1.0:1787383152.643359:0:7501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d710000 x1874206979539840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787383168 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383152.643374:0:7501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1874206979539840:0@lo:901: 00000100:00080000:2.0:1787383152.643852:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383152.644522:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d713480 x1874206979539456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383152.644535:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979539456:0@lo:400: 00010000:00080000:3.0:1787383152.644668:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d711180 x1874206979539328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383152.644677:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979539328:0@lo:400: 20000000:01000000:1.0:1787383152.671079:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383152.671101:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787383152.671155:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383152.671160:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383152.671183:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.671202:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce905 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.671211:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.671252:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383152.671267:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 14 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.671282:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979539968:0@lo:104: 00000100:00100000:2.0:1787383152.671349:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383152.671394:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc069a3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383152.672121:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979539968 00000100:00100000:1.0:1787383152.672132:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979539968 00000100:00100000:1.0:1787383152.672188:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383152.672198:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979539968:12345-0@lo:104: 00010000:00010000:1.0:1787383152.672213:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383152.672278:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383152.672284:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:5819:x1874206979539968:12345-0@lo:104: Request processed in 88us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383152.672291:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383152.672840:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1874206979539968:0@lo:104: 00010000:00010000:2.0:1787383152.672861:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673349:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383152.673358:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673366:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515600 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383152.673371:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673380:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383152.673388:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383152.673394:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383152.673439:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673446:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383152.673464:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673471:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01515600/0x42020b050d5ce905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce90c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673488:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383152.673490:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383152.673492:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383152.673544:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979540096:0@lo:103: 00000100:00100000:3.0:1787383152.673607:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383152.673708:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540096 00000100:00100000:0.0:1787383152.673713:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540096 00010000:00010000:0.0:1787383152.673747:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 15 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383152.673778:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383152.673786:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:3313:x1874206979540096:12345-0@lo:103: 00010000:00010000:0.0:1787383152.673797:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383152.673802:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 15 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673813:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 15 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673827:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046c00/0x42020b050d5ce90c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce905 expref: 15 pid: 5798 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673840:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673850:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383152.673865:0:5789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002705537s 00010000:00010000:0.0:1787383152.673887:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673895:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673902:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673908:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673921:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383152.673926:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673934:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673949:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.673959:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383152.673994:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:3313:x1874206979540096:12345-0@lo:103: Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383152.674001:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383152.674119:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979540096:0@lo:103: 00010000:00010000:0.0:1787383152.675013:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.675026:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383152.675033:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01514000/0x42020b050d5ce9c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383152.682790:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:7488:x1874206979539712:12345-0@lo:253: Request processed in 42673us (42763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383152.682804:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383152.683012:0:7488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7488:1874206979539712:0@lo:253: 10000000:01000000:1.0:1787383152.683028:0:7488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787383152.683044:0:7488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383152.683046:0:7488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383152.683047:0:7488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383152.683048:0:7488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383152.683050:0:7488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383152.683051:0:7488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383152.683053:0:7488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383152.683054:0:7488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383152.683055:0:7488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383152.683057:0:7488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383152.683058:0:7488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787383152.683074:0:7488:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787383152.691376:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383152.691559:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383152.691902:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383152.692108:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383152.692318:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383152.692544:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787383152.693741:0:7488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787383152.874342:0:7488:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787383152.874349:0:7488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787383152.874381:0:7488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787383152.874453:0:7488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787383152.874475:0:7488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787383152.874493:0:7488:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787383153.484043:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383154.507191:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383154.954169:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979540224:0@lo:13: 00000100:00100000:2.0:1787383154.954259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383154.954431:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540224 00000100:00100000:3.0:1787383154.954440:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540224 00000100:00100000:3.0:1787383154.954503:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383154.954515:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979540224:12345-0@lo:13: 00002000:00000024:3.0:1787383154.954551:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787383154.954659:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383154.954808:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979540224:12345-0@lo:13: Request processed in 296us (549us total) trans 0 rc 0/0 00010000:00080000:0.0:1787383154.954817:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e0380 x1874206979540224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383154.954820:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383154.954843:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979540224:0@lo:13: 00010000:00010000:2.0:1787383155.531904:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383156.556146:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383157.578153:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383158.026235:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979540736:0@lo:400: 00000100:00100000:3.0:1787383158.026306:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.026364:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787383158.026370:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979540352:0@lo:400: 00000100:00100000:3.0:1787383158.026395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.026413:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979540864:0@lo:400: 00000100:00100000:3.0:1787383158.026433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.026453:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979540480:0@lo:400: 00000100:00100000:3.0:1787383158.026486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.026503:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383158.026507:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979540608:0@lo:400: 00000100:00100000:3.0:1787383158.026536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.026563:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540736 00000100:00100000:3.0:1787383158.026570:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540736 00000100:00100000:3.0:1787383158.026665:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383158.026674:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979540736:12345-0@lo:400: 00000100:00100000:3.0:1787383158.026738:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979540736:12345-0@lo:400: Request processed in 50us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.026752:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383158.026777:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540352 00000100:00100000:3.0:1787383158.026781:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540352 00000100:00100000:3.0:1787383158.026803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787383158.026808:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3314:x1874206979540352:12345-0@lo:400: 00000100:00100000:3.0:1787383158.026835:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3314:x1874206979540352:12345-0@lo:400: Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.026840:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787383158.026862:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540864 00000100:00100000:3.0:1787383158.026864:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540864 00000100:00100000:3.0:1787383158.026898:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540480 00000100:00100000:3.0:1787383158.026901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540480 00000100:00100000:3.0:1787383158.026909:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540608 00000100:00100000:3.0:1787383158.026910:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540608 00000100:00100000:3.0:1787383158.026922:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383158.026927:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979540864:12345-0@lo:400: 00000100:00100000:3.0:1787383158.026951:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979540864:12345-0@lo:400: Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.026969:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383158.026978:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383158.026983:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979540480:12345-0@lo:400: 00000100:00100000:3.0:1787383158.027011:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979540480:12345-0@lo:400: Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.027016:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383158.027024:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383158.027029:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979540608:12345-0@lo:400: 00000100:00100000:3.0:1787383158.027048:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979540608:12345-0@lo:400: Request processed in 19us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.027058:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787383158.027078:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383158.027083:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383158.027315:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e0380 x1874206979540608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383158.027330:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979540608:0@lo:400: 00010000:00080000:3.0:1787383158.027338:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e3800 x1874206979540480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383158.027346:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979540480:0@lo:400: 00000100:00100000:3.0:1787383158.027372:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979540352:0@lo:400: 00010000:00080000:3.0:1787383158.027380:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e2a00 x1874206979540864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383158.027388:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979540864:0@lo:400: 00010000:00080000:3.0:1787383158.027396:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e0a80 x1874206979540736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383158.027403:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979540736:0@lo:400: 00010000:00010000:3.0:1787383158.602621:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383158.804451:0:7844:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1787383159.049972:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383159.049982:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc3dc13000 from 30 10000000:01000000:3.0:1787383159.049988:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383159.050032:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.050065:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.050075:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383159.050094:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979540992:0@lo:101: 00000100:00100000:3.0:1787383159.050159:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.050219:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383159.050268:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979540992 00000100:00100000:2.0:1787383159.050279:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979540992 00000100:00100000:2.0:1787383159.050337:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383159.050347:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979540992:12345-0@lo:101: 00010000:00010000:2.0:1787383159.050361:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383159.050376:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce9d0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383159.050407:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383159.050419:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383159.050430:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515600, rc 0) 00000100:00100000:2.0:1787383159.050490:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979540992:12345-0@lo:101: Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383159.050503:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383159.050586:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979540992:0@lo:101: 00010000:00010000:0.0:1787383159.050603:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.050612:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.050665:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541120:0@lo:501: 00000100:00100000:0.0:1787383159.050691:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.050715:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.050763:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541120 00000100:00100000:3.0:1787383159.050767:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541120 00000100:00100000:3.0:1787383159.050800:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787383159.050807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979541120:12345-0@lo:501: 00000100:00100000:3.0:1787383159.051219:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979541120:12345-0@lo:501: Request processed in 408us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.051228:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383159.051588:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541120:0@lo:501: 00000100:00100000:0.0:1787383159.051624:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541248:0@lo:503: 00000100:00100000:0.0:1787383159.051666:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.051691:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.051703:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541248 00000100:00100000:0.0:1787383159.051706:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541248 00000100:00100000:0.0:1787383159.051726:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383159.051732:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979541248:12345-0@lo:503: 00000100:00100000:0.0:1787383159.051938:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979541248:12345-0@lo:503: Request processed in 205us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.051958:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383159.052003:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541248:0@lo:503: 00000100:00100000:2.0:1787383159.056592:0:7860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7860:1874206979541376:0@lo:502: 00000100:00100000:2.0:1787383159.056750:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383159.056809:0:7860:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.056842:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541376 00000100:00100000:3.0:1787383159.056850:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541376 00000100:00100000:3.0:1787383159.056919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383159.056929:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7860:x1874206979541376:12345-0@lo:502: 00000100:00100000:3.0:1787383159.057357:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7860:x1874206979541376:12345-0@lo:502: Request processed in 427us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.057366:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787383159.058816:0:7860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7860:1874206979541376:0@lo:502: 00000100:00100000:2.0:1787383159.058913:0:7860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7860:1874206979541504:0@lo:502: 00000100:00100000:2.0:1787383159.058978:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383159.059014:0:7860:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.059250:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541504 00000100:00100000:0.0:1787383159.059256:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541504 00000100:00100000:0.0:1787383159.059302:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787383159.059312:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7860:x1874206979541504:12345-0@lo:502: 00000100:00100000:0.0:1787383159.059541:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:7860:x1874206979541504:12345-0@lo:502: Request processed in 230us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.059549:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383159.059662:0:7860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7860:1874206979541504:0@lo:502: 00000040:00080000:3.0:1787383159.059683:0:7860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787383159.064433:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787383159.064471:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383159.064484:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.064496:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383159.064507:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787383159.064510:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787383159.064514:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383159.064557:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.064566:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.064577:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.064604:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541632:0@lo:101: 00000100:00100000:0.0:1787383159.064679:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.064727:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.064782:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541632 00000100:00100000:3.0:1787383159.064797:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541632 00000100:00100000:3.0:1787383159.064857:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787383159.064891:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979541632:12345-0@lo:101: 00010000:00010000:3.0:1787383159.064907:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383159.064920:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce9de expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.064954:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce9de expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.064965:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9de expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.064974:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01663c00, rc 0) 00000100:00100000:3.0:1787383159.065023:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979541632:12345-0@lo:101: Request processed in 158us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.065030:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787383159.065781:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541632:0@lo:101: 00010000:00010000:1.0:1787383159.065801:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.065813:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383159.065937:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541760:0@lo:501: 00000100:00100000:0.0:1787383159.066068:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.066114:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.066317:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541760 00000100:00100000:3.0:1787383159.066323:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541760 00000100:00100000:3.0:1787383159.066364:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787383159.066372:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979541760:12345-0@lo:501: 00000100:00100000:3.0:1787383159.066654:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979541760:12345-0@lo:501: Request processed in 282us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.066662:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787383159.066888:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541760:0@lo:501: 00000100:00100000:1.0:1787383159.066926:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541888:0@lo:503: 00000100:00100000:1.0:1787383159.066983:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.067017:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.068063:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979541888 00000100:00100000:0.0:1787383159.068084:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979541888 00000100:00100000:0.0:1787383159.068133:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787383159.068141:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979541888:12345-0@lo:503: 00000100:00100000:0.0:1787383159.068395:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979541888:12345-0@lo:503: Request processed in 254us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.068403:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383159.068537:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979541888:0@lo:503: 00000100:00100000:1.0:1787383159.069831:0:7861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7861:1874206979542016:0@lo:502: 00000100:00100000:1.0:1787383159.069918:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.069969:0:7861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.070121:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542016 00000100:00100000:0.0:1787383159.070128:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542016 00000100:00100000:0.0:1787383159.070172:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787383159.070181:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:7861:x1874206979542016:12345-0@lo:502: 00000100:00100000:0.0:1787383159.070424:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:7861:x1874206979542016:12345-0@lo:502: Request processed in 243us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.070432:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787383159.070601:0:7861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7861:1874206979542016:0@lo:502: 00000020:01000000:3.0:1787383159.070631:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383159.070641:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383159.070643:0:7861:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383159.070650:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383159.070658:0:7861:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787383159.070678:0:7861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7861:1874206979542144:0@lo:502: 00000100:00100000:3.0:1787383159.070716:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.070742:0:7861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.070784:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542144 00000100:00100000:0.0:1787383159.070789:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542144 00000100:00100000:0.0:1787383159.070828:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383159.070835:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:7861:x1874206979542144:12345-0@lo:502: 00000100:00100000:0.0:1787383159.070995:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:7861:x1874206979542144:12345-0@lo:502: Request processed in 159us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.071001:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787383159.071096:0:7861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7861:1874206979542144:0@lo:502: 00000020:01000000:1.0:1787383159.071118:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383159.071124:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383159.071126:0:7861:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383159.071131:0:7861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787383159.073287:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787383159.073342:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383159.073356:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.073373:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383159.073421:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787383159.073426:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc2750b800 from 30 10000000:01000000:0.0:1787383159.073429:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383159.073498:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.073506:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.073518:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.073551:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542272:0@lo:101: 00000100:00100000:0.0:1787383159.073647:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.073704:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.073785:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542272 00000100:00100000:1.0:1787383159.073798:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542272 00000100:00100000:1.0:1787383159.073862:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787383159.073896:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979542272:12345-0@lo:101: 00010000:00010000:1.0:1787383159.073910:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383159.073924:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce9ec expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.073958:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.073970:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.073981:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01411800, rc 0) 00000100:00100000:1.0:1787383159.074079:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542272:12345-0@lo:101: Request processed in 185us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.074087:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787383159.074307:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542272:0@lo:101: 00010000:00010000:3.0:1787383159.074322:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.074331:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383159.074386:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542400:0@lo:501: 00000100:00100000:3.0:1787383159.074418:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.074461:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.074512:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542400 00000100:00100000:1.0:1787383159.074516:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542400 00000100:00100000:1.0:1787383159.074547:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787383159.074563:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542400:12345-0@lo:501: 00000100:00100000:1.0:1787383159.075288:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542400:12345-0@lo:501: Request processed in 728us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.075297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787383159.075345:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542400:0@lo:501: 00000100:00100000:1.0:1787383159.075383:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542528:0@lo:503: 00000100:00100000:1.0:1787383159.075428:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.075454:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.075467:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542528 00000100:00100000:1.0:1787383159.075471:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542528 00000100:00100000:3.0:1787383159.075762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383159.075844:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542528:12345-0@lo:503: 00000100:00100000:3.0:1787383159.076789:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542528:12345-0@lo:503: Request processed in 948us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.076798:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787383159.077977:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542528:0@lo:503: 00000100:00100000:1.0:1787383159.079066:0:7862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7862:1874206979542656:0@lo:502: 00000100:00100000:1.0:1787383159.079268:0:7862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.079347:0:7862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.079715:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542656 00000100:00100000:0.0:1787383159.079724:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542656 00000100:00100000:0.0:1787383159.079897:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787383159.079908:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:7862:x1874206979542656:12345-0@lo:502: 00000100:00100000:0.0:1787383159.080198:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:7862:x1874206979542656:12345-0@lo:502: Request processed in 291us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.080206:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787383159.080349:0:7862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7862:1874206979542656:0@lo:502: 00000100:00100000:3.0:1787383159.080409:0:7862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7862:1874206979542784:0@lo:502: 00000100:00100000:3.0:1787383159.080459:0:7862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.081251:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542784 00000100:00100000:1.0:1787383159.081259:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542784 00000100:00100000:1.0:1787383159.081302:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787383159.081310:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:7862:x1874206979542784:12345-0@lo:502: 00000100:00100000:1.0:1787383159.081803:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:7862:x1874206979542784:12345-0@lo:502: Request processed in 492us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.081811:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787383159.081953:0:7862:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.081974:0:7862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7862:1874206979542784:0@lo:502: 00000040:00080000:1.0:1787383159.082005:0:7862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787383159.082381:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787383159.082400:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383159.082409:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.082998:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383159.083009:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383159.083012:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffc2750b800 from 5 10000000:01000000:0.0:1787383159.083015:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383159.083051:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.083059:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.083068:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.083087:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542912:0@lo:101: 00000100:00100000:0.0:1787383159.083135:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.083238:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.083408:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979542912 00000100:00100000:1.0:1787383159.083504:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979542912 00000100:00100000:1.0:1787383159.083541:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787383159.083549:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979542912:12345-0@lo:101: 00010000:00010000:1.0:1787383159.083571:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383159.083753:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01411600/0x42020b050d5cea01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ce9fa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.083787:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01411600/0x42020b050d5cea01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ce9fa expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.083798:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01411600/0x42020b050d5cea01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9fa expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383159.083807:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01411600, rc 0) 00000100:00100000:1.0:1787383159.083858:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979542912:12345-0@lo:101: Request processed in 309us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.083887:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383159.084216:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979542912:0@lo:101: 00010000:00010000:0.0:1787383159.084232:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.084242:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.084312:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543040:0@lo:256: 00000100:00100000:0.0:1787383159.084347:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.084387:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.084706:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543040 00000100:00100000:3.0:1787383159.084713:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543040 00000100:00100000:3.0:1787383159.084755:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787383159.084774:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979543040:12345-0@lo:256: 20000000:01000000:3.0:1787383159.084801:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787383159.084818:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787383159.084821:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787383159.084927:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979543040:12345-0@lo:256: Request processed in 164us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.084934:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787383159.085246:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543040:0@lo:256: 10000000:01000000:0.0:1787383159.085312:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383159.085319:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.085329:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383159.085338:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787383159.085340:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787383159.085343:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383159.085367:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.085375:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.085384:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.085398:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543168:0@lo:101: 00000100:00100000:0.0:1787383159.085762:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.085858:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.085904:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543168 00000100:00100000:0.0:1787383159.085909:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543168 00000100:00100000:0.0:1787383159.085938:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383159.085956:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979543168:12345-0@lo:101: 00010000:00010000:0.0:1787383159.085965:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383159.085984:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cea08 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.086003:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cea08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.086012:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.086020:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046200, rc 0) 00000100:00100000:0.0:1787383159.086051:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979543168:12345-0@lo:101: Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383159.086058:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383159.086091:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543168:0@lo:101: 00010000:00010000:0.0:1787383159.086102:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.086110:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.086393:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543296:0@lo:501: 00000100:00100000:0.0:1787383159.086723:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.086793:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.087252:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543296 00000100:00100000:1.0:1787383159.088410:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543296 00000100:00100000:1.0:1787383159.088756:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787383159.088776:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979543296:12345-0@lo:501: 00000100:00100000:1.0:1787383159.089773:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979543296:12345-0@lo:501: Request processed in 994us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.089785:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787383159.091118:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543296:0@lo:501: 00000100:00100000:0.0:1787383159.092119:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543424:0@lo:503: 00000100:00100000:0.0:1787383159.092855:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.093119:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.098494:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543424 00000100:00100000:1.0:1787383159.098510:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543424 00000100:00100000:3.0:1787383159.098783:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787383159.098797:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979543424:12345-0@lo:503: 00000100:00100000:3.0:1787383159.099308:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979543424:12345-0@lo:503: Request processed in 513us (6454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.099317:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787383159.099614:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979543424:0@lo:503: 00000100:00100000:0.0:1787383159.099909:0:7865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7865:1874206979543552:0@lo:502: 00000100:00100000:0.0:1787383159.099967:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.099996:0:7865:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.100744:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543552 00000100:00100000:1.0:1787383159.100752:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543552 00000100:00100000:1.0:1787383159.100810:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383159.100819:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:7865:x1874206979543552:12345-0@lo:502: 00000100:00100000:1.0:1787383159.101373:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:7865:x1874206979543552:12345-0@lo:502: Request processed in 553us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.101382:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383159.101491:0:7865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7865:1874206979543552:0@lo:502: 00000020:01000000:0.0:1787383159.101523:0:7865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383159.101530:0:7865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787383159.101537:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383159.101540:0:7865:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787383159.101544:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383159.101547:0:7865:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1787383159.101569:0:7865:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383159.101571:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383159.101594:0:7865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ffc3cf7b380) 00000020:00000080:0.0:1787383159.101615:0:7865:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787383159.101622:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383159.101707:0:7865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787383159.101711:0:7865:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787383159.101719:0:7865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cea1d 00010000:00080000:0.0:1787383159.101750:0:7865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc3dc74000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1787383159.101999:0:7865:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787383159.102395:0:7865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787383159.102577:0:7865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787383159.107133:0:7865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383159.107418:0:7865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383159.107468:0:7865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787383159.107527:0:7865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787383159.109338:0:7866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383159.109345:0:7866:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787383159.110318:0:7865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383159.110331:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787383159.110363:0:7865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787383159.110387:0:7865:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cea24 00000100:00080000:3.0:1787383159.110399:0:7865:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383159.110406:0:7865:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffc3dc74000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1787383159.110446:0:7865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffb025c8000 x1874206979543680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383159.110512:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979543680:0@lo:8: 00000100:00100000:0.0:1787383159.110592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383159.112634:0:7865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787383159.112737:0:7865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383159.112745:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383159.112747:0:7865:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787383159.112751:0:7865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383159.112755:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383159.112757:0:7865:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383159.112760:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383159.112762:0:7865:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787383159.112808:0:7865:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7865:1874206979543808:0@lo:502: 00000100:00100000:3.0:1787383159.112900:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.112938:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543808 00000100:00100000:3.0:1787383159.112954:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543808 00000100:00100000:3.0:1787383159.112997:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383159.113006:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:7865:x1874206979543808:12345-0@lo:502: 00000100:00100000:3.0:1787383159.113240:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:7865:x1874206979543808:12345-0@lo:502: Request processed in 233us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.113248:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383159.113289:0:7865:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.113312:0:7865:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:7865:1874206979543808:0@lo:502: 00000020:01000000:3.0:1787383159.113335:0:7865:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383159.113340:0:7865:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383159.113341:0:7865:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787383159.113346:0:7865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787383159.113824:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979543936:0@lo:400: 00000100:00100000:3.0:1787383159.113861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.113917:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383159.113925:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979544064:0@lo:400: 00000100:00100000:3.0:1787383159.113957:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.113987:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979544192:0@lo:400: 00000100:00100000:3.0:1787383159.114016:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383159.114143:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543936 00000100:00100000:2.0:1787383159.114148:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543936 00000100:00100000:2.0:1787383159.114182:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544064 00000100:00100000:2.0:1787383159.114185:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544064 00000100:00100000:2.0:1787383159.114199:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383159.114208:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979543936:12345-0@lo:400: 00000100:00100000:2.0:1787383159.114248:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979543936:12345-0@lo:400: Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383159.114254:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383159.114285:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383159.114291:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979544064:12345-0@lo:400: 00000100:00100000:2.0:1787383159.114317:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979544064:12345-0@lo:400: Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383159.114322:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000000:0.0:1787383159.114695:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787383159.114718:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787383159.114728:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.114740:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383159.114750:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787383159.114752:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffc173ecd40 from 1 10000000:01000000:0.0:1787383159.114755:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787383159.114786:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.114794:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383159.114803:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383159.114818:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979544448:0@lo:101: 00000100:00100000:0.0:1787383159.114856:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.114910:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.119116:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383159.119138:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979544320:0@lo:400: 00000100:00100000:3.0:1787383159.119197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.119249:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544320 00000100:00100000:3.0:1787383159.119257:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544320 00000100:00100000:3.0:1787383159.119304:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787383159.119312:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979544320:12345-0@lo:400: 00000100:00100000:3.0:1787383159.119366:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979544320:12345-0@lo:400: Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.119373:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787383159.119398:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544448 00000100:00100000:3.0:1787383159.119402:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544448 00000100:00100000:3.0:1787383159.119424:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383159.119430:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979544448:12345-0@lo:101: 00010000:00010000:3.0:1787383159.119441:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383159.119460:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cea2b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.119484:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cea2b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.119497:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea2b expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.119506:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01663a00, rc 0) 00000100:00100000:3.0:1787383159.119536:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979544448:12345-0@lo:101: Request processed in 106us (4680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383159.119542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383159.119587:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979544448:0@lo:101: 00010000:00010000:3.0:1787383159.119605:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.119616:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383159.119687:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979544576:0@lo:501: 00000100:00100000:3.0:1787383159.119713:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.119725:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383159.119737:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544576 00000100:00100000:3.0:1787383159.119741:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544576 00000100:00100000:3.0:1787383159.119761:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383159.119768:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979544576:12345-0@lo:501: 00000100:00100000:3.0:1787383159.120022:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979544576:12345-0@lo:501: Request processed in 253us (308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383159.120030:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383159.120064:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979544576:0@lo:501: 10000000:01000000:3.0:1787383159.120089:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787383159.120096:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383159.120104:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787383159.120137:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d715500 x1874206979544064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.120149:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979544064:0@lo:400: 00010000:00080000:3.0:1787383159.120162:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d717100 x1874206979543936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.120170:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979543936:0@lo:400: 00010000:00080000:3.0:1787383159.120228:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d714380 x1874206979544320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.120238:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979544320:0@lo:400: 00000100:00100000:1.0:1787383159.120779:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979543680 00000100:00100000:1.0:1787383159.120786:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979543680 00000100:00100000:1.0:1787383159.122138:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544192 00000100:00100000:1.0:1787383159.122149:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544192 00000100:00100000:1.0:1787383159.122180:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383159.122189:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979544192:12345-0@lo:400: 00000100:00100000:1.0:1787383159.122269:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979544192:12345-0@lo:400: Request processed in 80us (8251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.122275:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383159.122291:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383159.122295:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1874206979543680:12345-0@lo:8: 00010000:00080000:1.0:1787383159.122318:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1787383159.122344:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cea39 00002000:00100000:1.0:1787383159.122358:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ffc3fcb0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787383159.122362:0:6600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787383159.122366:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787383159.122490:0:6600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787383159.122635:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787383159.122664:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383159.122718:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874206979543680:12345-0@lo:8: Request processed in 421us (12126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.122725:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787383159.122778:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025c8000 x1874206979543680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383159.122806:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383159.122817:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787383159.122830:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787383159.122836:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787383159.122839:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc74000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787383159.122861:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787383159.122897:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979543680:0@lo:8: 00000004:00080000:0.0:1787383159.123483:0:7866:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383159.123618:0:7866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183337749160ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787383159.125668:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d715c00 x1874206979544192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.125689:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979544192:0@lo:400: 00000004:00080000:1.0:1787383159.212548:0:7867:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787383159.214338:0:7867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979544832:0@lo:7: 00000100:00100000:1.0:1787383159.214423:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.214519:0:7867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.214548:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979544704:0@lo:13: 00000100:00100000:1.0:1787383159.214800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.214842:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544832 00000100:00100000:1.0:1787383159.214850:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544832 00000100:00100000:1.0:1787383159.214920:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383159.214928:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7867:x1874206979544832:12345-0@lo:7: 00000100:00080000:2.0:1787383159.222007:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383159.222039:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544704 00000100:00100000:2.0:1787383159.222049:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544704 00000100:00100000:2.0:1787383159.224016:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383159.224053:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979544704:12345-0@lo:13: 00002000:00000024:2.0:1787383159.224096:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787383159.224210:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979544704:12345-0@lo:13: Request processed in 164us (9407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383159.224218:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787383159.229996:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d713b80 x1874206979544704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.230024:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979544704:0@lo:13: 00002000:00080000:1.0:1787383159.238292:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787383159.238301:0:6600:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787383159.238398:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7867:x1874206979544832:12345-0@lo:7: Request processed in 23466us (23970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.238410:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787383159.240922:0:7867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d710000 x1874206979544832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383159.240952:0:7867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979544832:0@lo:7: 00000004:00080000:0.0:1787383159.240977:0:7867:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787383159.241023:0:7867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979544960:0@lo:5: 00000100:00100000:0.0:1787383159.241079:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383159.241131:0:7867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383159.244298:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979544960 00000100:00100000:0.0:1787383159.244315:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979544960 00000100:00100000:0.0:1787383159.244378:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383159.244388:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7867:x1874206979544960:12345-0@lo:5: 00002000:00080000:0.0:1787383159.244420:0:6601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787383159.244425:0:6601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787383159.246353:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7867:x1874206979544960:12345-0@lo:5: Request processed in 1960us (5267us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787383159.246365:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787383159.251106:0:7867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc05153480 x1874206979544960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383159.251130:0:7867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979544960:0@lo:5: 00000004:00080000:1.0:1787383159.253763:0:7867:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787383159.259043:0:7867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979545088:0@lo:700: 00000100:00100000:3.0:1787383159.259160:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.259205:0:7867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.259322:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545088 00000100:00100000:1.0:1787383159.259330:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545088 00000100:00100000:1.0:1787383159.259386:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383159.259396:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7867:x1874206979545088:12345-0@lo:700: 00000100:00100000:1.0:1787383159.259435:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6607:1874206979545216:0@lo:700: 00000100:00100000:1.0:1787383159.259479:0:6607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383159.259497:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.259512:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545216 00000100:00100000:1.0:1787383159.259515:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545216 00000100:00100000:1.0:1787383159.259547:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383159.259553:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6607:x1874206979545216:12345-0@lo:700: 00000004:00080000:3.0:1787383159.307742:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787383159.355992:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787383159.362477:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6607:x1874206979545216:12345-0@lo:700: Request processed in 102917us (102990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383159.362500:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383159.362644:0:6607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d713480 x1874206979545216/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787383175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383159.362662:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6607:1874206979545216:0@lo:700: 40000000:02000000:1.0:1787383159.362674:0:6607:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1787383159.495615:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787383159.495633:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787383159.497084:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7867:x1874206979545088:12345-0@lo:700: Request processed in 237681us (237915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383159.497099:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383159.497196:0:7867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025cb480 x1874206979545088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383175 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.497208:0:7867:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787383159.497227:0:7867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979545088:0@lo:700: 00000004:02000040:3.0:1787383159.540014:0:7867:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787383159.544864:0:7867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979545344:0@lo:5: 00000100:00100000:3.0:1787383159.545245:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383159.545294:0:7867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc069a3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383159.545341:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545344 00000100:00100000:1.0:1787383159.545348:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545344 00000100:00100000:1.0:1787383159.545402:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383159.545411:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7867:x1874206979545344:12345-0@lo:5: 00002000:00080000:1.0:1787383159.552890:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787383159.552915:0:6600:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787383159.558338:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7867:x1874206979545344:12345-0@lo:5: Request processed in 12920us (13084us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787383159.558352:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787383159.558760:0:7867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025cb480 x1874206979545344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383175 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383159.558797:0:7867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7867:1874206979545344:0@lo:5: 00000004:00080000:3.0:1787383159.558813:0:7867:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787383159.628226:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383160.074093:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383160.074118:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979545472:0@lo:13: 00000100:00100000:2.0:1787383160.074189:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383160.074286:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545472 00000100:00100000:3.0:1787383160.074294:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545472 00000100:00100000:3.0:1787383160.074348:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383160.074357:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979545472:12345-0@lo:13: 00002000:00000024:3.0:1787383160.074390:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383160.074433:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979545472:12345-0@lo:13: Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383160.074453:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787383160.074652:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383160.074691:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025c9f80 x1874206979545472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383160.074709:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979545472:0@lo:13: 00010000:00010000:3.0:1787383160.652308:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383161.674380:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383162.701860:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383163.722073:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787383163.730910:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787383164.165391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.165954:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962745472 00000100:00100000:3.0:1787383164.165965:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962745472 00000100:00100000:3.0:1787383164.166015:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1787383164.166025:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1874206962745472:12345-192.168.202.19@tcp:250: 00010000:00080000:3.0:1787383164.166053:0:5797:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 3b225dd3-d6cb-4127-b60c-55fdf555fef3@192.168.202.19@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1787383164.166086:0:5797:0:(genops.c:1406:class_connect()) connect: client 3b225dd3-d6cb-4127-b60c-55fdf555fef3, cookie 0x42020b050d5cea40 00000100:00080000:3.0:1787383164.166212:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9ffc34f95800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383164.166286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+5:2347:x1874206962745472:12345-192.168.202.19@tcp:250: Request processed in 262us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.166294:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:2.0:1787383164.171137:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979545600:0@lo:400: 00000100:00100000:2.0:1787383164.171205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383164.171250:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383164.171267:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979545728:0@lo:400: 00000100:00100000:2.0:1787383164.171290:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383164.171321:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545600 00000100:00100000:2.0:1787383164.171328:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545600 00000100:00100000:2.0:1787383164.171365:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383164.171372:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979545600:12345-0@lo:400: 00000100:00100000:2.0:1787383164.171451:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979545600:12345-0@lo:400: Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383164.171464:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383164.171514:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545728 00000100:00100000:2.0:1787383164.171518:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545728 00000100:00100000:2.0:1787383164.171555:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383164.171562:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979545728:12345-0@lo:400: 00000100:00100000:2.0:1787383164.172245:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979545728:12345-0@lo:400: Request processed in 682us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383164.172253:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787383164.172288:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d712680 x1874206979545728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383164.172303:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979545728:0@lo:400: 00000100:00100000:2.0:1787383164.172311:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979545600:0@lo:400: 00000100:00100000:1.0:1787383164.174007:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979546240:0@lo:400: 00000100:00100000:1.0:1787383164.174064:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383164.174135:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383164.174142:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979546112:0@lo:400: 00000100:00100000:1.0:1787383164.174168:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383164.174198:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979545856:0@lo:400: 00000100:00100000:1.0:1787383164.174219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383164.174236:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383164.174242:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979545984:0@lo:400: 00000100:00100000:1.0:1787383164.174388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383164.175008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.175041:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546112 00000100:00100000:1.0:1787383164.175049:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546112 00000100:00100000:1.0:1787383164.175097:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545856 00000100:00100000:1.0:1787383164.175100:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545856 00000100:00100000:1.0:1787383164.175119:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383164.175128:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979546112:12345-0@lo:400: 00000100:00100000:1.0:1787383164.175182:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979546112:12345-0@lo:400: Request processed in 55us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.175188:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383164.175206:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383164.175212:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979545856:12345-0@lo:400: 00000100:00100000:1.0:1787383164.175241:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979545856:12345-0@lo:400: Request processed in 29us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.175271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787383164.175287:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787383164.175314:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d710e00 x1874206979546112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383164.175327:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979546112:0@lo:400: 00010000:00080000:1.0:1787383164.175352:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d711880 x1874206979545856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383164.175361:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979545856:0@lo:400: 00000100:00100000:3.0:1787383164.178922:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962745600 00000100:00100000:3.0:1787383164.178936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962745600 00000100:00100000:3.0:1787383164.178993:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:3.0:1787383164.179003:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+5:5549:x1874206962745600:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1787383164.179032:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383164.179050:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6afd5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.179078:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.179089:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.179099:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01662600, rc 0) 00000100:00100000:3.0:1787383164.179162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+6:5549:x1874206962745600:12345-192.168.202.19@tcp:101: Request processed in 161us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.179170:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:2.0:1787383164.181197:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546240 00000100:00100000:2.0:1787383164.181212:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546240 00000100:00100000:2.0:1787383164.181289:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979545984 00000100:00100000:2.0:1787383164.181293:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979545984 00000100:00100000:2.0:1787383164.181315:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383164.181325:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979546240:12345-0@lo:400: 00000100:00100000:2.0:1787383164.181429:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979546240:12345-0@lo:400: Request processed in 105us (7365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383164.181437:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383164.181485:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383164.181502:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979545984:12345-0@lo:400: 00000100:00100000:2.0:1787383164.181552:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979545984:12345-0@lo:400: Request processed in 50us (7162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383164.181585:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787383164.181608:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383164.181612:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787383164.181655:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d712300 x1874206979546240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383164.181666:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787383164.181683:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979546240:0@lo:400: 00010000:00080000:2.0:1787383164.181715:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d711f80 x1874206979545984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383164.181725:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979545984:0@lo:400: 00000100:00100000:0.0:1787383164.188787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383164.191991:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962745728 00000100:00100000:2.0:1787383164.192008:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962745728 00000100:00100000:2.0:1787383164.192075:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:2.0:1787383164.192088:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+6:5549:x1874206962745728:12345-192.168.202.19@tcp:501: 00000100:00100000:2.0:1787383164.192500:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+6:5549:x1874206962745728:12345-192.168.202.19@tcp:501: Request processed in 406us (3717us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383164.192512:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:0.0:1787383164.194572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383164.194722:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962745856 00000100:00100000:2.0:1787383164.194735:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962745856 00000100:00100000:2.0:1787383164.194804:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1787383164.194815:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+6:5549:x1874206962745856:12345-192.168.202.19@tcp:101: 00010000:00010000:2.0:1787383164.194837:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383164.194859:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6afdc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383164.194953:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383164.194968:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383164.194981:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515800, rc 0) 00000100:00100000:2.0:1787383164.195103:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+7:5549:x1874206962745856:12345-192.168.202.19@tcp:101: Request processed in 288us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383164.195111:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1787383164.201008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.201092:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962745984 00000100:00100000:3.0:1787383164.201109:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962745984 00000100:00100000:3.0:1787383164.201216:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:3.0:1787383164.201227:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+7:5549:x1874206962745984:12345-192.168.202.19@tcp:501: 00000100:00100000:3.0:1787383164.201544:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5549:x1874206962745984:12345-192.168.202.19@tcp:501: Request processed in 310us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.201555:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1787383164.206349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.207602:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746112 00000100:00100000:1.0:1787383164.207615:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746112 00000100:00100000:1.0:1787383164.207701:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1787383164.207710:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5549:x1874206962746112:12345-192.168.202.19@tcp:503: 00000100:00100000:1.0:1787383164.208425:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5549:x1874206962746112:12345-192.168.202.19@tcp:503: Request processed in 711us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.208438:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:0.0:1787383164.222523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.222639:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746240 00000100:00100000:3.0:1787383164.222654:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746240 00000100:00100000:3.0:1787383164.222719:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1787383164.222729:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5568:x1874206962746240:12345-192.168.202.19@tcp:502: 00000100:00100000:3.0:1787383164.223188:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5568:x1874206962746240:12345-192.168.202.19@tcp:502: Request processed in 459us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.223207:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:2.0:1787383164.265532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.265681:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746368 00000100:00100000:1.0:1787383164.265695:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746368 00000100:00100000:1.0:1787383164.265771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1787383164.265785:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5568:x1874206962746368:12345-192.168.202.19@tcp:502: 00000100:00100000:1.0:1787383164.266210:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5568:x1874206962746368:12345-192.168.202.19@tcp:502: Request processed in 418us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.266219:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1787383164.275094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.275297:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746496 00000100:00100000:3.0:1787383164.275311:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746496 00000100:00100000:3.0:1787383164.275377:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:3.0:1787383164.275390:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5549:x1874206962746496:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1787383164.276089:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383164.276115:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01662e00/0x42020b050d5cea55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b006 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.276154:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01662e00/0x42020b050d5cea55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b006 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.276168:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01662e00/0x42020b050d5cea55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b006 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.276178:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01662e00, rc 0) 00000100:00100000:3.0:1787383164.276380:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5549:x1874206962746496:12345-192.168.202.19@tcp:101: Request processed in 992us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.276389:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1787383164.283088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.285725:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746624 00000100:00100000:1.0:1787383164.285769:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746624 00000100:00100000:1.0:1787383164.285835:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1787383164.285847:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5549:x1874206962746624:12345-192.168.202.19@tcp:256: 20000000:01000000:1.0:1787383164.285914:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787383164.285936:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787383164.285941:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787383164.285944:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787383164.285947:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787383164.291082:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5549:x1874206962746624:12345-192.168.202.19@tcp:256: Request processed in 5220us (7989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.291100:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1787383164.302330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.302661:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746752 00000100:00100000:3.0:1787383164.302675:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746752 00000100:00100000:3.0:1787383164.302750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:3.0:1787383164.302761:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5549:x1874206962746752:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1787383164.302784:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383164.302827:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b00d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.302923:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.302939:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383164.302953:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01662200, rc 0) 00000100:00100000:3.0:1787383164.303030:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5549:x1874206962746752:12345-192.168.202.19@tcp:101: Request processed in 271us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.303039:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:3.0:1787383164.309828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.310132:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962746880 00000100:00100000:1.0:1787383164.310146:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962746880 00000100:00100000:1.0:1787383164.310229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:1.0:1787383164.310241:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5549:x1874206962746880:12345-192.168.202.19@tcp:501: 00000100:00100000:1.0:1787383164.310667:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5549:x1874206962746880:12345-192.168.202.19@tcp:501: Request processed in 427us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.310677:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1787383164.313060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.313393:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747008 00000100:00100000:1.0:1787383164.313991:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747008 00000100:00100000:1.0:1787383164.314806:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:1.0:1787383164.314825:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5549:x1874206962747008:12345-192.168.202.19@tcp:503: 00000100:00100000:1.0:1787383164.315613:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5549:x1874206962747008:12345-192.168.202.19@tcp:503: Request processed in 788us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.315625:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:0.0:1787383164.327343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383164.327635:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747136 00000100:00100000:3.0:1787383164.327650:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747136 00000100:00100000:3.0:1787383164.327726:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:3.0:1787383164.327739:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5572:x1874206962747136:12345-192.168.202.19@tcp:502: 00000100:00100000:3.0:1787383164.328395:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5572:x1874206962747136:12345-192.168.202.19@tcp:502: Request processed in 652us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.328657:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:3.0:1787383164.334160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.334453:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747264 00000100:00100000:1.0:1787383164.334478:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747264 00000100:00100000:1.0:1787383164.334554:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:1.0:1787383164.334568:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5572:x1874206962747264:12345-192.168.202.19@tcp:502: 00000100:00100000:1.0:1787383164.334991:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5572:x1874206962747264:12345-192.168.202.19@tcp:502: Request processed in 426us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.335001:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:0.0:1787383164.342835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383164.343419:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747392 00000100:00100000:1.0:1787383164.343434:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747392 00000100:00100000:1.0:1787383164.343504:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1787383164.343514:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1874206962747392:12345-192.168.202.19@tcp:38: 00010000:00080000:1.0:1787383164.343555:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1787383164.343621:0:5805:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cea63 00000004:00100000:1.0:1787383164.343662:0:5805:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787383164.343670:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787383164.432742:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383164.432930:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962747392:12345-192.168.202.19@tcp:38: Request processed in 89354us (90063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383164.432944:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1787383164.682566:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383164.685727:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979546368:0@lo:13: 00000100:00100000:0.0:1787383164.685854:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383164.687344:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546368 00000100:00100000:3.0:1787383164.687360:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546368 00000100:00100000:3.0:1787383164.687441:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383164.687450:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979546368:12345-0@lo:13: 00002000:00000024:3.0:1787383164.687500:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383164.687595:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979546368:12345-0@lo:13: Request processed in 145us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383164.687620:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787383164.687946:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025c8e00 x1874206979546368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383164.687973:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979546368:0@lo:13: 00010000:00010000:0.0:1787383164.746495:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383165.199948:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979546496:0@lo:13: 00000100:00100000:2.0:1787383165.200048:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383165.200233:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546496 00000100:00100000:0.0:1787383165.200245:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546496 00000100:00100000:0.0:1787383165.200424:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383165.200437:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979546496:12345-0@lo:13: 00002000:00000024:0.0:1787383165.200485:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383165.200548:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979546496:12345-0@lo:13: Request processed in 113us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383165.200556:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787383165.200976:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc05151500 x1874206979546496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383165.201001:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979546496:0@lo:13: 00000100:00100000:0.0:1787383165.460851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383165.461066:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747520 00000100:00100000:1.0:1787383165.461081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747520 00000100:00100000:1.0:1787383165.461179:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1787383165.461193:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:0:x1874206962747520:12345-192.168.202.19@tcp:41: 00000004:00000024:1.0:1787383165.461254:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787383165.461345:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383165.464823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383165.464978:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383165.464992:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787383165.468346:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:0:x1874206962747520:12345-192.168.202.19@tcp:41: Request processed in 7145us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383165.468358:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1787383165.468396:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747648 00000100:00100000:1.0:1787383165.468404:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747648 00000100:00100000:1.0:1787383165.469666:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1787383165.469700:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962747648:12345-192.168.202.19@tcp:41: 00000004:00000024:1.0:1787383165.469736:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787383165.470821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962747648:12345-192.168.202.19@tcp:41: Request processed in 1121us (6008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383165.470832:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1787383165.474919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383165.475009:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747776 00000100:00100000:3.0:1787383165.475022:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747776 00000100:00100000:3.0:1787383165.475145:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1787383165.475159:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962747776:12345-192.168.202.19@tcp:40: 00000100:00100000:3.0:1787383165.475285:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962747776:12345-192.168.202.19@tcp:40: Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383165.475294:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383165.482159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383165.482215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383165.482343:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748288 00000100:00100000:1.0:1787383165.482357:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748288 00000100:00100000:1.0:1787383165.482438:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:1.0:1787383165.482451:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2351:x1874206962748288:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1787383165.482570:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2351:x1874206962748288:12345-192.168.202.19@tcp:400: Request processed in 121us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383165.482580:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:3.0:1787383165.484371:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748160 00000100:00100000:0.0:1787383165.484638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383165.484698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383165.484776:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962747904 00000100:00100000:2.0:1787383165.484781:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962747904 00000100:00100000:2.0:1787383165.484825:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748032 00000100:00100000:2.0:1787383165.484828:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748032 00000100:00100000:2.0:1787383165.484845:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1787383165.484855:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1874206962747904:12345-192.168.202.19@tcp:8: 00010000:00080000:2.0:1787383165.484936:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1787383165.484983:0:6599:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cea6a 00002000:00100000:2.0:1787383165.485002:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5843774-e16e-46d1-9ea7-9bdf9153dca9/ffff9ffb0199c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383165.485020:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383165.485552:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383165.485597:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383165.485683:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962747904:12345-192.168.202.19@tcp:8: Request processed in 827us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383165.485692:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1787383165.485723:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383165.485729:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1874206962748032:12345-192.168.202.19@tcp:8: 00010000:00080000:2.0:1787383165.485750:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1787383165.485772:0:6599:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cea71 00002000:00100000:2.0:1787383165.485778:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5843774-e16e-46d1-9ea7-9bdf9153dca9/ffff9ffb01999000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383165.485786:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383165.486073:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383165.486089:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383165.486114:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962748032:12345-192.168.202.19@tcp:8: Request processed in 384us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383165.486122:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1787383165.486999:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748160 00000100:00100000:3.0:1787383165.487082:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1787383165.487093:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962748160:12345-192.168.202.19@tcp:33: 00000004:00080000:3.0:1787383165.524380:0:5806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37202us 00000004:00200000:1.0:1787383165.551322:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787383165.551556:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5549:x1874206962748160:12345-192.168.202.19@tcp:33: Request processed in 64456us (69402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383165.551575:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1787383165.735921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383165.736412:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748416 00000100:00100000:1.0:1787383165.736533:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748416 00000100:00100000:1.0:1787383165.736607:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1787383165.736616:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5590:x1874206962748416:12345-192.168.202.19@tcp:101: 00010000:00010000:1.0:1787383165.736642:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383165.736671:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01411c00/0x42020b050d5cea78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b037 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.736741:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.736772:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.736784:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383165.737634:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787383165.737643:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383165.737736:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.737777:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01411c00/0x42020b050d5cea78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b037 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.737799:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b037 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383165.737810:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc06943d00) 00010000:00010000:1.0:1787383165.737814:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383165.737818:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01410800, rc 0) 00000100:00100000:1.0:1787383165.738752:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:5590:x1874206962748416:12345-192.168.202.19@tcp:101: Request processed in 2127us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383165.738765:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:3.0:1787383165.771791:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383166.794172:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383167.818841:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383168.015091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383168.015237:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748544 00000100:00100000:2.0:1787383168.015250:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748544 00000100:00100000:2.0:1787383168.015349:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383168.015362:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:5642:x1874206962748544:12345-192.168.202.19@tcp:41: 00000004:00000024:2.0:1787383168.015423:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787383168.015517:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:5642:x1874206962748544:12345-192.168.202.19@tcp:41: Request processed in 158us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383168.015524:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00080000:1.0:1787383168.015635:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383168.019243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383168.019437:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748672 00000100:00100000:0.0:1787383168.019450:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748672 00000100:00100000:0.0:1787383168.019613:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1787383168.019625:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5642:x1874206962748672:12345-192.168.202.19@tcp:13: 00002000:00000024:0.0:1787383168.019677:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383168.020047:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5642:x1874206962748672:12345-192.168.202.19@tcp:13: Request processed in 422us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383168.020055:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00080000:1.0:1787383168.022709:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383168.027941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383168.028105:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748800 00000100:00100000:2.0:1787383168.028132:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748800 00000100:00100000:2.0:1787383168.028221:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383168.028235:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5642:x1874206962748800:12345-192.168.202.19@tcp:13: 00002000:00000024:2.0:1787383168.028291:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383168.028384:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:5642:x1874206962748800:12345-192.168.202.19@tcp:13: Request processed in 151us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383168.028392:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00080000:1.0:1787383168.029064:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787383168.843051:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383169.299954:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979546624:0@lo:400: 00000100:00100000:2.0:1787383169.300056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383169.300164:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546624 00000100:00100000:2.0:1787383169.300174:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546624 00000100:00100000:0.0:1787383169.305738:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787383169.305762:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979546624:12345-0@lo:400: 00000100:00100000:0.0:1787383169.305924:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979546624:12345-0@lo:400: Request processed in 169us (5867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.305933:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787383169.306390:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979546624:0@lo:400: 00000100:00100000:0.0:1787383169.308049:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383169.308077:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979546752:0@lo:400: 00000100:00100000:0.0:1787383169.308154:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383169.309356:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979546880:0@lo:400: 00000100:00100000:0.0:1787383169.309414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383169.309466:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546752 00000100:00100000:0.0:1787383169.309476:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546752 00000100:00100000:0.0:1787383169.309528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979546880 00000100:00100000:0.0:1787383169.309531:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979546880 00000100:00100000:0.0:1787383169.309566:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383169.309576:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979546752:12345-0@lo:400: 00000100:00100000:0.0:1787383169.309636:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979546752:12345-0@lo:400: Request processed in 61us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.309645:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383169.309667:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383169.309674:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979546880:12345-0@lo:400: 00000100:00100000:0.0:1787383169.309706:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979546880:12345-0@lo:400: Request processed in 33us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.309726:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787383169.309745:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383169.309785:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979546880:0@lo:400: 00000100:00100000:0.0:1787383169.309820:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979546752:0@lo:400: 00000100:00100000:0.0:1787383169.311622:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383169.311652:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979547008:0@lo:400: 00000100:00100000:0.0:1787383169.311731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383169.311785:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547008 00000100:00100000:0.0:1787383169.311793:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547008 00000100:00100000:0.0:1787383169.312919:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383169.312936:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979547008:12345-0@lo:400: 00000100:00100000:0.0:1787383169.313029:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979547008:12345-0@lo:400: Request processed in 97us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.313037:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787383169.313076:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383169.313323:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c869c00 x1874206979547008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383169.313343:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979547008:0@lo:400: 00000100:00100000:0.0:1787383169.313418:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979547136:0@lo:400: 00000100:00100000:0.0:1787383169.313465:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383169.313505:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547136 00000100:00100000:0.0:1787383169.313511:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547136 00000100:00100000:0.0:1787383169.313551:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787383169.313557:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979547136:12345-0@lo:400: 00000100:00100000:0.0:1787383169.313594:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979547136:12345-0@lo:400: Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.313621:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787383169.313637:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383169.313656:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979547136:0@lo:400: 00000100:00100000:0.0:1787383169.313682:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383169.313687:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979547264:0@lo:400: 00000100:00100000:0.0:1787383169.313712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383169.313734:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547264 00000100:00100000:0.0:1787383169.313737:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547264 00000100:00100000:0.0:1787383169.313763:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383169.313769:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979547264:12345-0@lo:400: 00000100:00100000:0.0:1787383169.313802:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979547264:12345-0@lo:400: Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383169.313808:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787383169.313821:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787383169.313837:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c869c00 x1874206979547264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383169.313846:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979547264:0@lo:400: 00000001:00100000:3.0:1787383169.388354:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000100:00100000:0.0:1787383169.802835:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979547392:0@lo:13: 00000100:00100000:0.0:1787383169.802966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383169.803147:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547392 00000100:00100000:1.0:1787383169.803158:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547392 00000100:00100000:1.0:1787383169.803243:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383169.803255:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979547392:12345-0@lo:13: 00002000:00000024:1.0:1787383169.803301:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383169.808698:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979547392:12345-0@lo:13: Request processed in 5429us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383169.808717:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787383169.809276:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025caa00 x1874206979547392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383169.809305:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979547392:0@lo:13: 00010000:00010000:3.0:1787383169.867618:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787383169.894996:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000001:00100000:1.0:1787383169.900339:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000100:00100000:3.0:1787383170.316677:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979547520:0@lo:13: 00000100:00100000:3.0:1787383170.316771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383170.320195:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547520 00000100:00100000:2.0:1787383170.320215:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547520 00000100:00100000:2.0:1787383170.320290:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383170.320308:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979547520:12345-0@lo:13: 00002000:00000024:2.0:1787383170.320369:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383170.320633:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979547520:12345-0@lo:13: Request processed in 327us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383170.320642:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787383170.320726:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c86aa00 x1874206979547520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383170.320749:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979547520:0@lo:13: 00000100:00100000:2.0:1787383170.547070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383170.547115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383170.547158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383170.547312:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749184 00000100:00100000:3.0:1787383170.547325:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749184 00000100:00100000:3.0:1787383170.547418:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1787383170.547436:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962749184:12345-192.168.202.19@tcp:400: 00000100:00100000:3.0:1787383170.547532:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962749184:12345-192.168.202.19@tcp:400: Request processed in 103us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383170.547541:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00080000:3.0:1787383170.547568:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383170.547616:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749056 00000100:00100000:3.0:1787383170.547620:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749056 00000100:00100000:3.0:1787383170.547658:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1787383170.547666:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962749056:12345-192.168.202.19@tcp:400: 00000100:00100000:3.0:1787383170.547708:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962749056:12345-192.168.202.19@tcp:400: Request processed in 43us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383170.547715:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00080000:3.0:1787383170.547734:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383170.547913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383170.547939:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749312 00000100:00100000:2.0:1787383170.547943:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749312 00000100:00100000:2.0:1787383170.547975:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383170.547982:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962749312:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1787383170.548025:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962749312:12345-192.168.202.19@tcp:400: Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383170.548033:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1787383170.548384:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962748928 00000100:00100000:0.0:1787383170.548390:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962748928 00000100:00100000:0.0:1787383170.548497:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:0.0:1787383170.548514:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962748928:12345-192.168.202.19@tcp:400: 00000100:00100000:0.0:1787383170.548547:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962748928:12345-192.168.202.19@tcp:400: Request processed in 36us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383170.548555:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00080000:3.0:1787383170.549356:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1787383170.682125:0:8157:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787383170.896998:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383171.916466:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383172.938006:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383173.962348:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787383174.341548:0:8305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffea32ca560 00000020:00000080:0.0:1787383174.341567:0:8305:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787383174.341572:0:8305:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787383174.341581:0:8305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea32cc7f0 20000000:00000080:0.0:1787383174.341589:0:8305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc3c95c400 uarg=0000000000000000 20000000:01000000:0.0:1787383174.341636:0:8305:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787383174.341638:0:8305:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787383174.341641:0:8305:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787383174.341646:0:8305:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787383174.341653:0:8305:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787383174.341668:0:8305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787383174.341672:0:8305:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787383174.342264:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787383174.342268:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787383174.343593:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787383174.344325:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787383174.344521:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787383174.344560:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787383174.344575:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787383174.344577:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787383174.345667:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787383174.346722:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787383174.346777:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787383174.346843:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787383174.346858:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787383174.346861:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787383174.348126:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787383174.348690:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787383174.348764:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787383174.348824:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787383174.348837:0:8305:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787383174.348839:0:8305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787383174.350538:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787383174.351210:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787383174.351275:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787383174.351311:0:8305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1787383174.351326:0:8305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787383174.351347:0:8305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351487:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce97c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351497:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351504:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351510:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9de expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351517:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351523:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351530:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea2b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351540:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351558:0:8305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351565:0:8305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351606:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351621:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.351637:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547648:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383174.351788:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351798:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 9 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.351821:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547776:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383174.351854:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351862:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 18 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.351902:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547904:0@lo:104: 00000100:00100000:0.0:1787383174.351941:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383174.351984:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.351992:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352073:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548032:0@lo:104: 00000100:00100000:0.0:1787383174.352102:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383174.352132:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.352140:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 18 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352148:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548160:0@lo:104: 00010000:00010000:0.0:1787383174.352173:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.352182:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352188:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548288:0@lo:104: 00010000:00010000:0.0:1787383174.352209:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.352217:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352224:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548416:0@lo:104: 00010000:00010000:0.0:1787383174.352261:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.352274:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 18 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352282:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548544:0@lo:104: 00010000:00010000:0.0:1787383174.352309:0:8305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.352316:0:8305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 18 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.352324:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548672:0@lo:104: 00000100:00100000:0.0:1787383174.352338:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383174.352489:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787383174.352507:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.352519:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.352527:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.352536:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.352544:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.352551:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979547904 00000100:00100000:2.0:1787383174.352557:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979547904 00000100:00100000:2.0:1787383174.352592:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548032 00000100:00100000:2.0:1787383174.352594:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548032 00000100:00100000:2.0:1787383174.352602:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548160 00000100:00100000:2.0:1787383174.352604:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548160 00000100:00100000:2.0:1787383174.352612:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548288 00000100:00100000:2.0:1787383174.352614:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548288 00000100:00100000:2.0:1787383174.352622:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548416 00000100:00100000:2.0:1787383174.352624:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548416 00000100:00100000:2.0:1787383174.352632:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548544 00000100:00100000:2.0:1787383174.352634:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548544 00000100:00100000:2.0:1787383174.352642:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548672 00000100:00100000:2.0:1787383174.352644:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548672 00000100:00100000:2.0:1787383174.352657:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383174.352664:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:8305:x1874206979547904:12345-0@lo:104: 00010000:00010000:2.0:1787383174.352676:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.352733:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383174.352739:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+9:8305:x1874206979547904:12345-0@lo:104: Request processed in 75us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.352745:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383174.352765:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383174.352771:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2fdbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:8305:x1874206979548032:12345-0@lo:104: 00010000:00010000:2.0:1787383174.352779:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.352825:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383174.352830:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2fdbd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+8:8305:x1874206979548032:12345-0@lo:104: Request processed in 60us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.352835:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383174.352864:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383174.352886:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+7:8305:x1874206979548160:12345-0@lo:104: 00010000:00010000:2.0:1787383174.352894:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.352918:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787383174.352923:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+7:8305:x1874206979548160:12345-0@lo:104: Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.352928:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383174.352940:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383174.352945:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+6:8305:x1874206979548288:12345-0@lo:104: 00010000:00010000:2.0:1787383174.352951:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.352983:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787383174.352988:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+6:8305:x1874206979548288:12345-0@lo:104: Request processed in 43us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.352996:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383174.353021:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383174.353026:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:8305:x1874206979548416:12345-0@lo:104: 00010000:00010000:2.0:1787383174.353032:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353055:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787383174.353060:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:8305:x1874206979548416:12345-0@lo:104: Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.353065:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383174.353075:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383174.353081:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:8305:x1874206979548544:12345-0@lo:104: 00010000:00010000:2.0:1787383174.353087:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353110:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787383174.353114:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:8305:x1874206979548544:12345-0@lo:104: Request processed in 34us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.353119:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383174.353130:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383174.353135:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:8305:x1874206979548672:12345-0@lo:104: 00010000:00010000:2.0:1787383174.353142:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353173:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787383174.353178:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:8305:x1874206979548672:12345-0@lo:104: Request processed in 43us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.353185:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787383174.353203:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787383174.353209:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353216:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047000 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.353220:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353229:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.353236:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.353241:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.353272:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353279:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383174.353300:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353306:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cea2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea32 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353333:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787383174.353336:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353342:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046600 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.353345:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353352:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.353358:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.353363:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787383174.353586:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547904:0@lo:104: 00000100:00100000:0.0:1787383174.353596:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548032:0@lo:104: 00000100:00100000:0.0:1787383174.353604:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548160:0@lo:104: 00000100:00100000:0.0:1787383174.353610:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548288:0@lo:104: 00000100:00100000:0.0:1787383174.353617:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548416:0@lo:104: 00000100:00100000:0.0:1787383174.353624:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548544:0@lo:104: 00000100:00100000:0.0:1787383174.353632:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979548672:0@lo:104: 00010000:00010000:2.0:1787383174.353680:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353686:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383174.353694:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353700:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046600/0x42020b050d5cea08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cea0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353710:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787383174.353713:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353731:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046400 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.353734:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353742:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.353749:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.353755:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.353770:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.353775:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787383174.353835:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979549056:0@lo:103: 00000100:00100000:0.0:1787383174.353889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383174.354107:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.354116:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046400/0x42020b050d5ce9ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9f3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.354126:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787383174.354129:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.354135:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046e00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.354137:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.354154:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.354160:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.354165:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.354179:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.354186:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787383174.354285:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383174.354292:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979549184:0@lo:103: 00000100:00100000:0.0:1787383174.354316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383174.354463:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549056 00000100:00100000:1.0:1787383174.354469:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549056 00010000:00010000:1.0:1787383174.354496:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 19 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383174.354519:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549184 00000100:00100000:1.0:1787383174.354522:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549184 00010000:00010000:1.0:1787383174.354531:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 20 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383174.354542:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383174.354548:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+20:3312:x1874206979549056:12345-0@lo:103: 00010000:00010000:1.0:1787383174.354559:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383174.354564:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 20 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.354573:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 20 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.354593:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01411800/0x42020b050d5ce9f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce9ec expref: 20 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.354606:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383174.354887:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787383174.354896:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787383174.355670:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383174.355687:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3312:x1874206979549184:12345-0@lo:103: 00010000:00010000:3.0:1787383174.355699:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383174.355706:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383174.355717:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383174.355743:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01663c00/0x42020b050d5ce9e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce9de expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383174.355760:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383174.360050:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3312:x1874206979549056:12345-0@lo:103: Request processed in 5482us (6141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383174.360067:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787383174.360908:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.360923:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046e00/0x42020b050d5ce9de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9e5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.360941:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383174.360945:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.360952:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662400 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.360956:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.360966:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.360974:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.360997:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.361072:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361090:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383174.361100:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361106:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01662400/0x42020b050d5ce9d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361116:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383174.361120:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361125:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.361136:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361144:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.361150:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.361155:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.361169:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361457:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383174.361469:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361476:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ce9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce9ad expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361487:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383174.361491:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361497:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411000 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383174.361500:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361506:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383174.361511:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383174.361516:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383174.361529:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361534:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383174.361541:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361546:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411000/0x42020b050d5ce97c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce983 expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.361560:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383174.361568:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383174.361570:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383174.361584:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383174.361602:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979548800:0@lo:103: 00000100:00100000:2.0:1787383174.361679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.361728:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979549312:0@lo:103: 00000100:00100000:2.0:1787383174.361750:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.361773:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383174.361780:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979548928:0@lo:103: 00000100:00100000:2.0:1787383174.361817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.361967:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979549440:0@lo:103: 00000100:00100000:2.0:1787383174.361989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.362011:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383174.362019:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979549568:0@lo:103: 00000100:00100000:2.0:1787383174.362042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383174.362062:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548800 00000100:00100000:2.0:1787383174.362070:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548800 00010000:00010000:2.0:1787383174.362096:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 18 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383174.362116:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549312 00000100:00100000:2.0:1787383174.362118:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549312 00000100:00100000:1.0:1787383174.362277:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979548928 00000100:00100000:1.0:1787383174.362281:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979548928 00010000:00010000:1.0:1787383174.362298:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 20 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.362477:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 19 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383174.362513:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549440 00000100:00100000:1.0:1787383174.362517:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549440 00010000:00010000:1.0:1787383174.362663:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 21 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383174.362855:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+21:3312:x1874206979549184:12345-0@lo:103: Request processed in 7173us (8534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.362881:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383174.362892:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979549184:0@lo:103: 00000100:00100000:0.0:1787383174.362906:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979549056:0@lo:103: 00000100:00100000:2.0:1787383174.362956:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549568 00000100:00100000:2.0:1787383174.362961:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549568 00010000:00010000:2.0:1787383174.362976:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 22 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383174.363009:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383174.363017:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+22:3314:x1874206979548800:12345-0@lo:103: 00010000:00010000:2.0:1787383174.363031:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.363037:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 22 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363046:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 22 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363063:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01663a00/0x42020b050d5cea32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cea2b expref: 22 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363083:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.363149:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+21:3314:x1874206979548800:12345-0@lo:103: Request processed in 133us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.363156:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383174.363188:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383174.363195:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+20:3314:x1874206979548928:12345-0@lo:103: 00010000:00010000:2.0:1787383174.363204:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.363210:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 20 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363218:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 20 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.363223:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979548800:0@lo:103: 00010000:00010000:2.0:1787383174.363232:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046200/0x42020b050d5cea0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cea08 expref: 20 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363254:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.363293:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979548928:12345-0@lo:103: Request processed in 98us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.363299:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383174.363324:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383174.363332:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3314:x1874206979549312:12345-0@lo:103: 00000100:00100000:0.0:1787383174.363338:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979548928:0@lo:103: 00010000:00010000:2.0:1787383174.363340:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.363348:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363607:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363618:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515600/0x42020b050d5ce9d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce9d0 expref: 18 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363628:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.363667:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3314:x1874206979549312:12345-0@lo:103: Request processed in 336us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.363673:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383174.363688:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383174.363695:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3313:x1874206979549568:12345-0@lo:103: 00010000:00010000:2.0:1787383174.363702:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.363707:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 16 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363715:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 16 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363732:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515200/0x42020b050d5ce983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce97c expref: 16 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.363740:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.363771:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:3313:x1874206979549568:12345-0@lo:103: Request processed in 77us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.363777:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383174.363816:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979549568:0@lo:103: 00000100:00100000:0.0:1787383174.363834:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979549312:0@lo:103: 00000100:00100000:1.0:1787383174.363917:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383174.363925:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:3314:x1874206979549440:12345-0@lo:103: 00010000:00010000:1.0:1787383174.363935:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383174.363941:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 14 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.363950:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 14 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.363961:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01663800/0x42020b050d5ce9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce9a6 expref: 14 pid: 5798 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383174.363981:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383174.364019:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:3314:x1874206979549440:12345-0@lo:103: Request processed in 95us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383174.364026:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383174.364055:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547648:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383174.364060:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979549440:0@lo:103: 00000100:00100000:0.0:1787383174.364074:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8305:1874206979547776:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383174.364793:0:8305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383174.368337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383174.368451:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749568 00000100:00100000:2.0:1787383174.368463:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749568 00010000:00010000:2.0:1787383174.368503:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 10 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383174.368546:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1787383174.368556:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962749568:12345-192.168.202.19@tcp:103: 00010000:00010000:2.0:1787383174.368571:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.368577:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 10 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.368589:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 10 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.368608:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01662600/0x42020b050d5cea47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afd5 expref: 10 pid: 5796 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.368624:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.368681:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:2349:x1874206962749568:12345-192.168.202.19@tcp:103: Request processed in 125us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.368699:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1787383174.371067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383174.371148:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749440 00000100:00100000:2.0:1787383174.371157:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749440 00010000:00010000:2.0:1787383174.371194:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383174.371229:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1787383174.371239:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:2348:x1874206962749440:12345-192.168.202.19@tcp:103: 00010000:00010000:2.0:1787383174.371254:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383174.371260:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371272:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371290:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6afdc expref: 9 pid: 5798 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371319:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371327:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371343:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371356:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371385:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371392:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371397:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383174.371401:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371409:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371426:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383174.371436:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383174.371496:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:2348:x1874206962749440:12345-192.168.202.19@tcp:103: Request processed in 258us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383174.371504:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:0.0:1787383174.371848:0:8305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.371857:0:8305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383174.371863:0:8305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046800/0x42020b050d5cea86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383174.411766:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979549696:0@lo:400: 00000100:00100000:3.0:1787383174.411847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.411905:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979550208:0@lo:400: 00000100:00100000:3.0:1787383174.411933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.411969:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383174.411975:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979550080:0@lo:400: 00000100:00100000:3.0:1787383174.411998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.412023:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979549952:0@lo:400: 00000100:00100000:3.0:1787383174.412045:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.412063:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383174.412068:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979549824:0@lo:400: 00000100:00100000:3.0:1787383174.412090:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.412161:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550208 00000100:00100000:3.0:1787383174.412169:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550208 00000100:00100000:3.0:1787383174.412228:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549952 00000100:00100000:3.0:1787383174.412232:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549952 00000100:00100000:3.0:1787383174.412250:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383174.412260:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979550208:12345-0@lo:400: 00000100:00100000:3.0:1787383174.412510:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979550208:12345-0@lo:400: Request processed in 251us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.412527:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383174.412544:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383174.412551:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979549952:12345-0@lo:400: 00000100:00100000:3.0:1787383174.412586:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979549952:12345-0@lo:400: Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.412592:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383174.412609:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549696 00000100:00100000:3.0:1787383174.412613:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549696 00000100:00100000:3.0:1787383174.412636:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550080 00000100:00100000:3.0:1787383174.412639:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550080 00000100:00100000:3.0:1787383174.412651:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979549824 00000100:00100000:3.0:1787383174.412653:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979549824 00000100:00100000:3.0:1787383174.412667:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383174.412672:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979549696:12345-0@lo:400: 00000100:00100000:3.0:1787383174.412703:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979549696:12345-0@lo:400: Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.412710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383174.412724:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383174.412732:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979550080:12345-0@lo:400: 00000100:00100000:3.0:1787383174.412762:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979550080:12345-0@lo:400: Request processed in 32us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.412769:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383174.412782:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383174.412789:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979549824:12345-0@lo:400: 00000100:00100000:3.0:1787383174.412830:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979549824:12345-0@lo:400: Request processed in 42us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.412848:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787383174.412950:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383174.412955:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383174.412957:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383174.412991:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979550080:0@lo:400: 00000100:00100000:3.0:1787383174.413005:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979549696:0@lo:400: 00010000:00080000:3.0:1787383174.413018:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025c8000 x1874206979550208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383174.413029:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979550208:0@lo:400: 00000100:00100000:3.0:1787383174.413185:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979549824:0@lo:400: 00010000:00080000:3.0:1787383174.413200:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025cb480 x1874206979549952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383174.413210:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979549952:0@lo:400: 00000100:00100000:3.0:1787383174.922558:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979550336:0@lo:13: 00000100:00100000:3.0:1787383174.922625:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383174.925055:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550336 00000100:00100000:3.0:1787383174.925066:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550336 00000100:00100000:3.0:1787383174.925113:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383174.925122:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979550336:12345-0@lo:13: 00002000:00000024:3.0:1787383174.925156:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383174.925221:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979550336:12345-0@lo:13: Request processed in 100us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383174.925228:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787383174.925269:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e0700 x1874206979550336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383174.925296:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979550336:0@lo:13: 00010000:00010000:2.0:1787383174.986046:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383175.435128:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979550464:0@lo:13: 00000100:00100000:3.0:1787383175.435218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383175.435378:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550464 00000100:00100000:2.0:1787383175.435387:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550464 00000100:00100000:2.0:1787383175.435460:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383175.435470:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979550464:12345-0@lo:13: 00002000:00000024:2.0:1787383175.435511:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383175.435568:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979550464:12345-0@lo:13: Request processed in 100us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383175.435575:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787383175.435888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b6680 x1874206979550464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383175.435907:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979550464:0@lo:13: 00000100:00100000:3.0:1787383175.664447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383175.665044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383175.665084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383175.665250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383175.665369:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749696 00000100:00100000:1.0:1787383175.665388:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749696 00000100:00100000:3.0:1787383175.665457:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749824 00000100:00100000:3.0:1787383175.665468:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749824 00000100:00100000:1.0:1787383175.665483:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:1.0:1787383175.665497:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:2350:x1874206962749696:12345-192.168.202.19@tcp:400: 00000100:00100000:3.0:1787383175.665563:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1787383175.665577:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962749824:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1787383175.665603:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:2350:x1874206962749696:12345-192.168.202.19@tcp:400: Request processed in 106us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383175.665613:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:3.0:1787383175.665657:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962749824:12345-192.168.202.19@tcp:400: Request processed in 79us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383175.665667:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00080000:3.0:1787383175.665698:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383175.668275:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750080 00000100:00100000:2.0:1787383175.668303:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750080 00000100:00100000:2.0:1787383175.668446:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962749952 00000100:00100000:2.0:1787383175.668450:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962749952 00000100:00100000:1.0:1787383175.668520:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1787383175.668550:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962750080:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1787383175.668645:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962750080:12345-192.168.202.19@tcp:400: Request processed in 111us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383175.668653:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00080000:0.0:1787383175.668835:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383175.668842:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383175.670097:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383175.670118:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962749952:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1787383175.670214:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962749952:12345-192.168.202.19@tcp:400: Request processed in 105us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383175.670222:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:2.0:1787383176.011107:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787383176.266174:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787383176.266181:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc3ff86800 from 39 10000000:01000000:1.0:1787383176.266187:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383176.266236:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.266641:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.266674:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383176.266699:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550592:0@lo:101: 00000100:00100000:1.0:1787383176.266777:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.266858:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.267443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550592 00000100:00100000:2.0:1787383176.267453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550592 00000100:00100000:2.0:1787383176.267524:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787383176.267534:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+12:5800:x1874206979550592:12345-0@lo:101: 00010000:00010000:2.0:1787383176.267548:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383176.267566:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cea8d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.267592:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cea8d expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.267604:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea8d expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.267613:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515800, rc 0) 00000100:00100000:2.0:1787383176.267680:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979550592:12345-0@lo:101: Request processed in 148us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.267687:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787383176.267950:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550592:0@lo:101: 00010000:00010000:3.0:1787383176.267968:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.267976:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.268044:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550720:0@lo:501: 00000100:00100000:3.0:1787383176.268076:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.268111:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.268404:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550720 00000100:00100000:1.0:1787383176.268410:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550720 00000100:00100000:1.0:1787383176.268450:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787383176.268458:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979550720:12345-0@lo:501: 00000100:00100000:1.0:1787383176.268758:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979550720:12345-0@lo:501: Request processed in 299us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.268765:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787383176.268936:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550720:0@lo:501: 00000100:00100000:3.0:1787383176.268974:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550848:0@lo:503: 00000100:00100000:3.0:1787383176.269036:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.269071:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.269207:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550848 00000100:00100000:0.0:1787383176.269213:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550848 00000100:00100000:0.0:1787383176.269237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787383176.269243:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979550848:12345-0@lo:503: 00000100:00100000:0.0:1787383176.269442:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979550848:12345-0@lo:503: Request processed in 198us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.269449:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787383176.269732:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979550848:0@lo:503: 00000100:00100000:3.0:1787383176.270034:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8325:1874206979550976:0@lo:502: 00000100:00100000:3.0:1787383176.270090:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.271833:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.272038:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979550976 00000100:00100000:1.0:1787383176.272047:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979550976 00000100:00100000:1.0:1787383176.272091:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787383176.272100:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:8325:x1874206979550976:12345-0@lo:502: 00000100:00100000:1.0:1787383176.272388:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:8325:x1874206979550976:12345-0@lo:502: Request processed in 288us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.272396:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787383176.272649:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8325:1874206979550976:0@lo:502: 00000100:00100000:3.0:1787383176.272715:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8325:1874206979551104:0@lo:502: 00000100:00100000:3.0:1787383176.272758:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.272822:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.272890:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551104 00000100:00100000:1.0:1787383176.272895:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551104 00000100:00100000:1.0:1787383176.272918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787383176.272924:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:8325:x1874206979551104:12345-0@lo:502: 00000100:00100000:1.0:1787383176.273081:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:8325:x1874206979551104:12345-0@lo:502: Request processed in 155us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.273096:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787383176.273178:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8325:1874206979551104:0@lo:502: 00000040:00080000:3.0:1787383176.273199:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787383176.273375:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787383176.273398:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383176.273408:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.273420:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383176.273429:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787383176.273431:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787383176.273434:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383176.273460:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.273468:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.273477:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383176.273508:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551232:0@lo:101: 00000100:00100000:1.0:1787383176.273538:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.273565:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.273770:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551232 00000100:00100000:3.0:1787383176.273774:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551232 00000100:00100000:3.0:1787383176.273809:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787383176.273816:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+13:5800:x1874206979551232:12345-0@lo:101: 00010000:00010000:3.0:1787383176.273825:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383176.273838:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99800/0x42020b050d5ceaa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cea9b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.273858:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99800/0x42020b050d5ceaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cea9b expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.273904:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99800/0x42020b050d5ceaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cea9b expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.273912:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99800, rc 0) 00000100:00100000:3.0:1787383176.273954:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551232:12345-0@lo:101: Request processed in 139us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.273961:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787383176.274194:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551232:0@lo:101: 00010000:00010000:1.0:1787383176.274208:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.274216:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383176.274279:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551360:0@lo:501: 00000100:00100000:1.0:1787383176.274316:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.274350:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.274441:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551360 00000100:00100000:3.0:1787383176.274446:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551360 00000100:00100000:3.0:1787383176.274467:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787383176.274473:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551360:12345-0@lo:501: 00000100:00100000:3.0:1787383176.274738:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551360:12345-0@lo:501: Request processed in 264us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.274745:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787383176.275067:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551360:0@lo:501: 00000100:00100000:1.0:1787383176.275099:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551488:0@lo:503: 00000100:00100000:1.0:1787383176.275137:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.275161:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.275638:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551488 00000100:00100000:3.0:1787383176.275644:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551488 00000100:00100000:3.0:1787383176.275673:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787383176.275680:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551488:12345-0@lo:503: 00000100:00100000:3.0:1787383176.275852:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551488:12345-0@lo:503: Request processed in 172us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.275859:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787383176.275974:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551488:0@lo:503: 00000100:00100000:1.0:1787383176.279222:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8326:1874206979551616:0@lo:502: 00000100:00100000:1.0:1787383176.279322:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.279365:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.280029:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551616 00000100:00100000:2.0:1787383176.280046:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551616 00000100:00100000:2.0:1787383176.280089:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787383176.280097:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:8326:x1874206979551616:12345-0@lo:502: 00000100:00100000:2.0:1787383176.280331:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:8326:x1874206979551616:12345-0@lo:502: Request processed in 232us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.280338:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787383176.281676:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8326:1874206979551616:0@lo:502: 00000020:01000000:1.0:1787383176.281728:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383176.281742:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383176.281744:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787383176.281752:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787383176.281798:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8326:1874206979551744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.281862:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.281929:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.282634:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551744 00000100:00100000:3.0:1787383176.282641:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551744 00000100:00100000:3.0:1787383176.282686:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787383176.282695:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:8326:x1874206979551744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.282961:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:8326:x1874206979551744:12345-0@lo:502:llog_process_th.0 Request processed in 267us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.282970:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787383176.286516:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8326:1874206979551744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383176.286572:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383176.286584:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383176.286586:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383176.286593:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787383176.287253:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787383176.287279:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787383176.287292:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.287312:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383176.287323:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383176.287325:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc3dc13000 from 39 10000000:01000000:3.0:1787383176.287328:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383176.287374:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.287382:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.287391:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.287415:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.287480:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.287530:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.288485:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979551872 00000100:00100000:1.0:1787383176.288496:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979551872 00000100:00100000:1.0:1787383176.288559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787383176.288570:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:5800:x1874206979551872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383176.288583:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383176.288600:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01411000/0x42020b050d5ceab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceaa9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.288625:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01411000/0x42020b050d5ceab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceaa9 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.288640:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01411000/0x42020b050d5ceab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceaa9 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.288649:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01411000, rc 0) 00000100:00100000:1.0:1787383176.288715:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979551872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.288722:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383176.288980:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979551872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383176.288996:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.289005:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.289068:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.289098:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.289139:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.289805:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552000 00000100:00100000:1.0:1787383176.289812:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552000 00000100:00100000:1.0:1787383176.289843:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787383176.289851:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979552000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.290135:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979552000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.290141:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383176.293260:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.293347:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.293433:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.293475:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.293776:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552128 00000100:00100000:1.0:1787383176.293793:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552128 00000100:00100000:1.0:1787383176.293839:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787383176.293849:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979552128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.294076:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979552128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.294083:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383176.294485:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.295655:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8327:1874206979552256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.295720:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.295762:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.295889:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552256 00000100:00100000:1.0:1787383176.295895:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552256 00000100:00100000:1.0:1787383176.295944:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787383176.295954:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:8327:x1874206979552256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.296177:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:8327:x1874206979552256:12345-0@lo:502:llog_process_th.0 Request processed in 224us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.296185:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787383176.297550:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8327:1874206979552256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.297647:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8327:1874206979552384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.297705:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.297751:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.297925:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552384 00000100:00100000:0.0:1787383176.297943:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552384 00000100:00100000:0.0:1787383176.297985:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787383176.297994:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:8327:x1874206979552384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383176.298223:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:8327:x1874206979552384:12345-0@lo:502:llog_process_th.0 Request processed in 229us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.298230:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787383176.298656:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8327:1874206979552384:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787383176.298687:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787383176.299737:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787383176.299764:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383176.299775:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.299797:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383176.299806:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787383176.299809:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787383176.299812:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383176.299847:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.300001:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.300012:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.300035:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.300086:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.300128:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.300144:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552512 00000100:00100000:2.0:1787383176.300150:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552512 00000100:00100000:2.0:1787383176.300189:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787383176.300198:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:5800:x1874206979552512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383176.300209:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383176.300222:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515200/0x42020b050d5ceabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceab7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.300241:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515200/0x42020b050d5ceabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceab7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.300251:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515200/0x42020b050d5ceabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceab7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.300260:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515200, rc 0) 00000100:00100000:2.0:1787383176.300306:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979552512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.300313:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787383176.300400:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383176.300413:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.300422:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.300465:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.300491:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.300513:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.300597:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552640 00000100:00100000:0.0:1787383176.300602:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552640 00000100:00100000:0.0:1787383176.300634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787383176.300642:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979552640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.300916:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979552640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.300926:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.300986:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383176.301033:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.301069:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.301136:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc02bc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.304444:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552768 00000100:00100000:1.0:1787383176.304459:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552768 00000100:00100000:1.0:1787383176.304538:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787383176.304550:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979552768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.304817:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979552768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.304826:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383176.305369:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979552768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.305993:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8328:1874206979552896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.306048:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.306089:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.306262:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979552896 00000100:00100000:3.0:1787383176.306274:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979552896 00000100:00100000:3.0:1787383176.306317:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787383176.306326:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:8328:x1874206979552896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.306530:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:8328:x1874206979552896:12345-0@lo:502:llog_process_th.0 Request processed in 204us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.306537:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787383176.306596:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8328:1874206979552896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383176.306622:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383176.306636:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383176.306639:0:8328:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787383176.306646:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787383176.306667:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8328:1874206979553024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.306698:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.306719:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.306768:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553024 00000100:00100000:0.0:1787383176.306778:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553024 00000100:00100000:0.0:1787383176.306859:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787383176.306899:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:8328:x1874206979553024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383176.307041:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:8328:x1874206979553024:12345-0@lo:502:llog_process_th.0 Request processed in 175us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.307048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787383176.308184:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8328:1874206979553024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383176.308222:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383176.308230:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383176.308232:0:8328:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383176.308237:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787383176.308692:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787383176.308715:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383176.308728:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.308741:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383176.308753:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787383176.308755:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc2750b800 from 39 10000000:01000000:0.0:1787383176.308758:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383176.308796:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.308805:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.308814:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383176.308833:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.308936:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.308972:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.312627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553152 00000100:00100000:1.0:1787383176.312643:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553152 00000100:00100000:1.0:1787383176.312698:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383176.312707:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979553152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383176.312725:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383176.312743:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01410600/0x42020b050d5ceacc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceac5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.312769:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01410600/0x42020b050d5ceacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceac5 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.312780:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01410600/0x42020b050d5ceacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceac5 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.312799:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01410600, rc 0) 00000100:00100000:1.0:1787383176.312904:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.312911:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787383176.313641:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383176.313662:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.313673:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383176.313743:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.313782:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.313837:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.314604:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553280 00000100:00100000:1.0:1787383176.314613:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553280 00000100:00100000:1.0:1787383176.314650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787383176.314659:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.316279:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1614us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.316292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787383176.332151:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.332226:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.332342:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.332380:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.332530:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553408 00000100:00100000:3.0:1787383176.332537:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553408 00000100:00100000:3.0:1787383176.332597:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383176.332605:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.332830:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.332840:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787383176.333080:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.334176:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8329:1874206979553536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383176.334235:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.334282:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.334455:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553536 00000100:00100000:3.0:1787383176.334461:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553536 00000100:00100000:3.0:1787383176.334518:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383176.334528:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8329:x1874206979553536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.334938:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8329:x1874206979553536:12345-0@lo:502:llog_process_th.0 Request processed in 411us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.334947:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787383176.336580:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8329:1874206979553536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.336666:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8329:1874206979553664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383176.336722:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383176.336830:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.341558:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553664 00000100:00100000:0.0:1787383176.341574:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553664 00000100:00100000:0.0:1787383176.342620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787383176.342633:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8329:x1874206979553664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383176.342992:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8329:x1874206979553664:12345-0@lo:502:llog_process_th.0 Request processed in 359us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.343002:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787383176.343182:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8329:1874206979553664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787383176.343224:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787383176.344844:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787383176.344910:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383176.344923:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.344935:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383176.344963:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787383176.344965:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787383176.344968:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383176.345003:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.345012:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.345022:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.345044:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.345104:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.345150:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.345233:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553792 00000100:00100000:2.0:1787383176.345242:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553792 00000100:00100000:2.0:1787383176.345312:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787383176.345322:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979553792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383176.345335:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383176.345347:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01515600/0x42020b050d5ceada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cead3 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.345369:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01515600/0x42020b050d5ceada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cead3 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.345379:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01515600/0x42020b050d5ceada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cead3 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383176.345388:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515600, rc 0) 00000100:00100000:2.0:1787383176.345426:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979553792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.345433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787383176.347610:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383176.347639:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.347653:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383176.347733:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.347799:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.347844:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.348994:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979553920 00000100:00100000:2.0:1787383176.349006:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979553920 00000100:00100000:2.0:1787383176.349055:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787383176.349065:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979553920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383176.349385:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979553920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.349393:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787383176.351520:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.351581:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.351656:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.351695:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.351991:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554048 00000100:00100000:2.0:1787383176.351999:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554048 00000100:00100000:2.0:1787383176.352041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787383176.352050:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979554048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383176.352239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979554048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.352270:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787383176.353775:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.354602:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8330:1874206979554176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.354674:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.354712:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383176.354804:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554176 00000100:00100000:2.0:1787383176.354810:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554176 00000100:00100000:2.0:1787383176.354849:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787383176.354858:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8330:x1874206979554176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383176.355114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8330:x1874206979554176:12345-0@lo:502:llog_process_th.0 Request processed in 255us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.355122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787383176.355706:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8330:1874206979554176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383176.355742:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383176.355753:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383176.355755:0:8330:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383176.355761:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787383176.355805:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8330:1874206979554304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383176.355848:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383176.355899:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc04cd53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383176.356127:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554304 00000100:00100000:0.0:1787383176.356132:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554304 00000100:00100000:0.0:1787383176.356175:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787383176.356185:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8330:x1874206979554304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383176.356853:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8330:x1874206979554304:12345-0@lo:502:llog_process_th.0 Request processed in 667us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.356861:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787383176.357096:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8330:1874206979554304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383176.357125:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383176.357131:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383176.357134:0:8330:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787383176.357138:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787383176.357621:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787383176.357641:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787383176.357652:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.357663:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383176.357673:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787383176.357675:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffc173ecd40 from 1 10000000:01000000:0.0:1787383176.357679:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787383176.357707:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.357715:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.357725:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383176.357744:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.357781:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.357836:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383176.357923:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554432 00000100:00100000:1.0:1787383176.357929:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554432 00000100:00100000:1.0:1787383176.357967:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383176.357976:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979554432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383176.357987:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383176.358002:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc00030a00/0x42020b050d5ceae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceae1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.358023:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc00030a00/0x42020b050d5ceae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceae1 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.358034:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc00030a00/0x42020b050d5ceae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceae1 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383176.358042:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc00030a00, rc 0) 00000100:00100000:1.0:1787383176.358073:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979554432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383176.358085:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787383176.358332:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383176.358344:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.358352:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383176.358394:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383176.358419:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.358449:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383176.358492:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554560 00000100:00100000:3.0:1787383176.358496:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554560 00000100:00100000:3.0:1787383176.358534:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787383176.358541:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979554560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383176.358760:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979554560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (338us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383176.358766:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787383176.359026:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979554560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787383176.359048:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383176.359054:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383176.359062:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383176.688285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383176.698453:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750208 00000100:00100000:3.0:1787383176.698473:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750208 00000100:00100000:3.0:1787383176.698570:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:3.0:1787383176.698582:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:5563:x1874206962750208:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1787383176.698599:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383176.698618:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98200/0x42020b050d5ceaef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b03e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.698648:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98200/0x42020b050d5ceaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b03e expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.698661:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98200/0x42020b050d5ceaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b03e expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.698671:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98200, rc 0) 00000100:00100000:3.0:1787383176.698743:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750208:12345-192.168.202.19@tcp:101: Request processed in 163us (10467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.698751:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:1.0:1787383176.703844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383176.703984:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750336 00000100:00100000:0.0:1787383176.703994:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750336 00000100:00100000:0.0:1787383176.704051:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:0.0:1787383176.704062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750336:12345-192.168.202.19@tcp:501: 00000100:00100000:0.0:1787383176.704407:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750336:12345-192.168.202.19@tcp:501: Request processed in 346us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.704415:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:1.0:1787383176.714364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383176.715052:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750464 00000100:00100000:0.0:1787383176.715090:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750464 00000100:00100000:0.0:1787383176.715152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:0.0:1787383176.715162:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750464:12345-192.168.202.19@tcp:503: 00000100:00100000:0.0:1787383176.715654:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750464:12345-192.168.202.19@tcp:503: Request processed in 492us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.715664:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1787383176.728022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383176.728333:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750592 00000100:00100000:3.0:1787383176.728342:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750592 00000100:00100000:3.0:1787383176.728409:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:3.0:1787383176.728420:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:6042:x1874206962750592:12345-192.168.202.19@tcp:502: 00000100:00100000:3.0:1787383176.729292:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:6042:x1874206962750592:12345-192.168.202.19@tcp:502: Request processed in 865us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.729307:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:1.0:1787383176.746615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383176.746720:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750720 00000100:00100000:0.0:1787383176.746731:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750720 00000100:00100000:0.0:1787383176.746801:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:0.0:1787383176.746813:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:6042:x1874206962750720:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383176.747170:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:6042:x1874206962750720:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 358us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.747179:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1787383176.751565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383176.751812:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750848 00000100:00100000:3.0:1787383176.751830:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750848 00000100:00100000:3.0:1787383176.751952:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:3.0:1787383176.751988:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962750848:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383176.752011:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383176.752035:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98000/0x42020b050d5ceaf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b045 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.752070:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98000/0x42020b050d5ceaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b045 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.752083:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98000/0x42020b050d5ceaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b045 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383176.752092:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98000, rc 0) 00000100:00100000:3.0:1787383176.752174:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962750848:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 188us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383176.752182:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:2.0:1787383176.754549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383176.756641:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962750976 00000100:00100000:1.0:1787383176.756657:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962750976 00000100:00100000:1.0:1787383176.756734:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:1.0:1787383176.756745:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962750976:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383176.757119:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962750976:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 374us (2584us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383176.757128:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00010000:00010000:0.0:1787383177.035846:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383178.059275:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383178.728557:0:8367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffcb71c560 00000020:00000080:3.0:1787383178.728579:0:8367:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383178.728584:0:8367:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383178.728594:0:8367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcb71e7f0 20000000:00000080:3.0:1787383178.728602:0:8367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc34df8400 uarg=0000000000000000 20000000:01000000:3.0:1787383178.728656:0:8367:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787383178.728664:0:8367:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787383178.728670:0:8367:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787383178.730222:0:8368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787383178.730429:0:8367:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787383178.738341:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787383178.738844:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787383178.738984:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787383178.739009:0:8367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787383178.739042:0:8367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739068:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739078:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce93d expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739085:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ce998 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739110:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739120:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739170:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739189:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 9 pid: 5796 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383178.739207:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554688:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383178.739327:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739811:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 18 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383178.739822:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554816:0@lo:104: 00000100:00100000:0.0:1787383178.739898:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383178.739938:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.739946:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 18 pid: 5798 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383178.739956:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554944:0@lo:104: 00000100:00100000:0.0:1787383178.739991:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383178.740010:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.740018:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 18 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383178.740027:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979555072:0@lo:104: 00000100:00100000:0.0:1787383178.740045:0:8367:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383178.740127:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383178.740147:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383178.740159:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554816 00000100:00100000:1.0:1787383178.740167:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554816 00000100:00100000:1.0:1787383178.740210:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979554944 00000100:00100000:1.0:1787383178.740213:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979554944 00000100:00100000:1.0:1787383178.740222:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555072 00000100:00100000:1.0:1787383178.740224:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555072 00000100:00100000:1.0:1787383178.740238:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383178.740247:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:8367:x1874206979554816:12345-0@lo:104: 00010000:00010000:1.0:1787383178.740262:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740329:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383178.740346:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:8367:x1874206979554816:12345-0@lo:104: Request processed in 100us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383178.740368:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383178.740388:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383178.740533:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:8367:x1874206979554944:12345-0@lo:104: 00010000:00010000:1.0:1787383178.740542:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740577:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383178.740583:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37ec6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:8367:x1874206979554944:12345-0@lo:104: Request processed in 190us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383178.740589:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383178.740625:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383178.740632:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:8367:x1874206979555072:12345-0@lo:104: 00010000:00010000:1.0:1787383178.740639:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740675:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787383178.740680:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:8367:x1874206979555072:12345-0@lo:104: Request processed in 50us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383178.740686:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787383178.740704:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787383178.740711:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740719:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662000 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:1.0:1787383178.740723:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740743:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383178.740752:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383178.740758:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383178.740800:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740807:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383178.740838:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740845:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01662000/0x42020b050d5ce998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce99f expref: -99 pid: 7488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740860:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383178.740863:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740908:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:1.0:1787383178.740911:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740917:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383178.740923:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383178.740934:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383178.740947:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740953:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383178.740959:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740965:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5ce93d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce944 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740974:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383178.740977:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740982:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047a00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:1.0:1787383178.740985:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.740992:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383178.741004:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383178.741009:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383178.741040:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.741046:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383178.741070:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.741077:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047a00/0x42020b050d5ce8bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ce8c6 expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.741093:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383178.741095:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383178.741097:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383178.741112:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979555200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383178.741145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383178.741177:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383178.741183:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979555328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383178.741204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383178.741226:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979555456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383178.741264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383178.741297:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555200 00000100:00100000:1.0:1787383178.741302:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555200 00010000:00010000:1.0:1787383178.741324:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 19 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383178.741362:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555328 00000100:00100000:1.0:1787383178.741366:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555328 00010000:00010000:1.0:1787383178.741377:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 20 pid: 5798 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383178.741387:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555456 00000100:00100000:1.0:1787383178.741390:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555456 00000100:00100000:0.0:1787383178.741600:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554816:0@lo:104: 00000100:00100000:0.0:1787383178.741611:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554944:0@lo:104: 00000100:00100000:0.0:1787383178.741620:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979555072:0@lo:104: 00010000:00010000:2.0:1787383178.741748:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383178.741770:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383178.741781:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+21:3312:x1874206979555200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383178.741796:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383178.741803:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 21 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741814:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 21 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741831:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046000/0x42020b050d5ce99f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce998 expref: 21 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741846:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383178.741913:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+20:3312:x1874206979555200:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383178.741920:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383178.741939:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383178.741945:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3312:x1874206979555328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383178.741953:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383178.741957:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 19 pid: 5798 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741967:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 19 pid: 5798 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741977:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047800/0x42020b050d5ce944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce93d expref: 19 pid: 5798 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.741986:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383178.742005:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3312:x1874206979555328:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383178.742011:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383178.742176:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979555328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383178.742185:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979555200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383178.742453:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383178.742490:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383178.742497:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3314:x1874206979555456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383178.742505:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383178.742510:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.742519:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.742531:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ce8c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ce8bf expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383178.742541:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383178.742572:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3314:x1874206979555456:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383178.742578:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383178.742603:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979555456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383178.745099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383178.745164:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751104 00000100:00100000:2.0:1787383178.745176:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751104 00010000:00010000:2.0:1787383178.745225:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 10 pid: 5796 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383178.745272:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1787383178.745282:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962751104:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383178.745304:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383178.745311:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 10 pid: 5796 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745357:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 10 pid: 5796 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745387:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745530:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745551:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745557:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745562:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745566:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745571:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046e00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383178.745574:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745580:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745587:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383178.745603:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383178.745663:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962751104:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 383us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383178.745669:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00010000:00010000:0.0:1787383178.746522:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01662200/0x42020b050d5cea5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b00d expref: 9 pid: 5796 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383178.746546:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1874206979554688:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383178.746587:0:8367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.746599:0:8367:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.746607:0:8367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383178.746630:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046e00/0x42020b050d5ceafd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383179.086221:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383179.530170:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979555584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383179.530387:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555584 00000100:00100000:3.0:1787383179.530396:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555584 00000100:00100000:3.0:1787383179.530484:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787383179.530494:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3315:x1874206979555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530569:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3315:x1874206979555584:12345-0@lo:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.530578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787383179.530654:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979555584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530710:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979555712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383179.530790:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555712 00000100:00100000:3.0:1787383179.530794:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555712 00000100:00100000:3.0:1787383179.530826:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383179.530832:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530897:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979555712:12345-0@lo:400:kworker.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.530903:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383179.530935:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979555712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530965:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383179.530971:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979555840:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.530995:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383179.531018:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555840 00000100:00100000:3.0:1787383179.531022:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555840 00000100:00100000:3.0:1787383179.531053:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383179.531060:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531099:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979555840:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.531117:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787383179.531135:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383179.531159:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979555840:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531194:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979555968:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531304:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383179.531339:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979555968 00000100:00100000:3.0:1787383179.531343:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979555968 00000100:00100000:3.0:1787383179.531376:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383179.531383:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979555968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531418:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979555968:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.531424:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787383179.531441:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383179.531458:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e2a00 x1874206979555968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383179.531469:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979555968:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531502:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979556096:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531526:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383179.531550:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556096 00000100:00100000:3.0:1787383179.531554:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556096 00000100:00100000:3.0:1787383179.531583:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383179.531590:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979556096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531622:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979556096:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.531628:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787383179.531653:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383179.531672:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979556096:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531701:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979556224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383179.531726:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383179.532438:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556224 00000100:00100000:2.0:1787383179.532447:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556224 00000100:00100000:2.0:1787383179.532496:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383179.532515:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979556224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383179.532576:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979556224:12345-0@lo:400:kworker.0 Request processed in 73us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383179.532582:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787383179.532621:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787383179.532660:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d7e2a00 x1874206979556224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383179.532673:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979556224:0@lo:400:kworker.0 00000100:00100000:1.0:1787383179.888248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383179.888389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751232 00000100:00100000:0.0:1787383179.888401:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751232 00000100:00100000:0.0:1787383179.888463:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:0.0:1787383179.888473:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:5563:x1874206962751232:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383179.888492:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383179.888512:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b04c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.888551:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.888562:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.888571:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383179.888639:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962751232:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 167us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.888646:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:3.0:1787383179.898339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383179.898458:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751360 00000100:00100000:0.0:1787383179.898469:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751360 00000100:00100000:0.0:1787383179.898543:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:0.0:1787383179.898554:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962751360:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383179.898929:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962751360:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 375us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.898948:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:1.0:1787383179.907228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383179.907520:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751488 00000100:00100000:3.0:1787383179.907532:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751488 00000100:00100000:3.0:1787383179.907589:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:3.0:1787383179.907599:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962751488:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383179.908017:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:5563:x1874206962751488:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 418us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.908025:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:2.0:1787383179.923714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383179.923993:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751616 00000100:00100000:1.0:1787383179.924004:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751616 00000100:00100000:1.0:1787383179.924067:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:1.0:1787383179.924077:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:6100:x1874206962751616:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383179.924343:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:6100:x1874206962751616:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 266us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383179.924361:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:2.0:1787383179.939944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383179.949854:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751744 00000100:00100000:3.0:1787383179.949898:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751744 00000100:00100000:3.0:1787383179.949964:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:3.0:1787383179.949976:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:6100:x1874206962751744:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383179.951436:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:6100:x1874206962751744:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 1454us (11562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383179.951450:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:3.0:1787383180.048395:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979556352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383180.048471:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.048545:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556352 00000100:00100000:3.0:1787383180.048553:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556352 00000100:00100000:3.0:1787383180.048603:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383180.048612:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979556352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383180.048660:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383180.048704:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979556352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.048711:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787383180.048761:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffb025c8e00 x1874206979556352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383180.048780:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979556352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383180.105956:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383180.170544:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383180.170552:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3ff86800 from 4 10000000:01000000:0.0:1787383180.170558:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383180.170604:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.170616:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.170626:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383180.170652:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383180.170720:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383180.170781:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.170843:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556480 00000100:00100000:3.0:1787383180.170851:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556480 00000100:00100000:3.0:1787383180.170933:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787383180.170943:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979556480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383180.170955:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383180.170968:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb0b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.171000:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.171010:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.171020:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98c00, rc 0) 00000100:00100000:3.0:1787383180.171058:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979556480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.171065:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787383180.171235:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383180.171249:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.171258:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383180.171317:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383180.171343:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383180.171359:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.171404:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556608 00000100:00100000:3.0:1787383180.171409:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556608 00000100:00100000:3.0:1787383180.171447:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787383180.171454:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979556608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.171693:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979556608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.171701:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787383180.171730:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.171771:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.171807:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.171822:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.171834:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556736 00000100:00100000:3.0:1787383180.171838:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556736 00000100:00100000:3.0:1787383180.171857:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787383180.171862:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979556736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.172018:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979556736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.172025:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787383180.172060:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979556736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.172220:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8429:1874206979556864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.172253:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.172270:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556864 00000100:00100000:3.0:1787383180.172273:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556864 00000100:00100000:3.0:1787383180.172294:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787383180.172301:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8429:x1874206979556864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.172417:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8429:x1874206979556864:12345-0@lo:502:llog_process_th.0 Request processed in 115us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.172428:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787383180.172453:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.172463:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8429:1874206979556864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383180.172485:0:8429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383180.172493:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383180.172495:0:8429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787383180.172502:0:8429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc3ff86800 00000020:00000080:3.0:1787383180.172505:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383180.175196:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8429:1874206979556992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383180.176097:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.176141:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979556992 00000100:00100000:3.0:1787383180.176149:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979556992 00000100:00100000:0.0:1787383180.176154:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.176205:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787383180.176214:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8429:x1874206979556992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.178610:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:8429:x1874206979556992:12345-0@lo:502:llog_process_th.0 Request processed in 2386us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.178623:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787383180.184175:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8429:1874206979556992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383180.184529:0:8429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383180.184538:0:8429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383180.184541:0:8429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787383180.184547:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787383180.185844:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787383180.185888:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383180.185900:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.185911:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383180.185923:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383180.185926:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3dc13000 from 4 10000000:01000000:3.0:1787383180.185928:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383180.185966:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.185985:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.185996:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.186020:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.188254:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.188311:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.188351:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557120 00000100:00100000:3.0:1787383180.188766:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557120 00000100:00100000:3.0:1787383180.188829:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383180.188838:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979557120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383180.188855:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383180.188892:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb19 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.188921:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.188934:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.188944:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383180.188992:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.188999:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383180.190533:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383180.190564:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.190577:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.190653:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.190701:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.190739:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc050c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.191468:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557248 00000100:00100000:2.0:1787383180.191476:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557248 00000100:00100000:2.0:1787383180.191522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787383180.191532:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.191811:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.191819:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787383180.201588:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.201668:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.201764:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.201814:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e46900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383180.202407:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557376 00000100:00100000:0.0:1787383180.202416:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557376 00000100:00100000:0.0:1787383180.202469:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787383180.202477:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383180.202679:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.202687:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787383180.204377:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.206239:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8433:1874206979557504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.206332:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.207905:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557504 00000100:00100000:3.0:1787383180.207919:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557504 00000100:00100000:3.0:1787383180.208078:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787383180.208089:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8433:x1874206979557504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.210552:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8433:x1874206979557504:12345-0@lo:502:llog_process_th.0 Request processed in 2459us (4213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.210565:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787383180.210819:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0944d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.210847:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8433:1874206979557504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383180.210919:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383180.210929:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383180.210931:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787383180.210939:0:8433:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc3dc13000 00000020:00000080:3.0:1787383180.210941:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383180.211013:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8433:1874206979557632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383180.213538:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.218853:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.219116:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557632 00000100:00100000:2.0:1787383180.219126:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557632 00000100:00100000:2.0:1787383180.219615:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787383180.219626:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8433:x1874206979557632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383180.220674:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:8433:x1874206979557632:12345-0@lo:502:llog_process_th.0 Request processed in 1046us (7136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.220685:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787383180.227529:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8433:1874206979557632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383180.227605:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383180.227614:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383180.227616:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787383180.227624:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787383180.228165:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787383180.228189:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383180.228201:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.228214:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383180.228225:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383180.228228:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc2750b800 from 4 10000000:01000000:3.0:1787383180.228230:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383180.228904:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.228915:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.228926:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.228950:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383180.229014:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.229066:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc274630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.234822:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557760 00000100:00100000:2.0:1787383180.234839:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557760 00000100:00100000:2.0:1787383180.234915:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787383180.234926:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979557760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383180.234945:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383180.234964:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb27 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.234995:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.235005:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.235013:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514e00, rc 0) 00000100:00100000:2.0:1787383180.235100:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979557760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (6084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.235108:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787383180.235180:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383180.235213:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.235224:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.235417:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.235451:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.235481:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.235496:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979557888 00000100:00100000:2.0:1787383180.235499:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979557888 00000100:00100000:2.0:1787383180.235520:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787383180.235526:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979557888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.235768:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979557888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.235776:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787383180.235808:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.235837:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.235889:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.235902:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.235914:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558016 00000100:00100000:2.0:1787383180.235917:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558016 00000100:00100000:2.0:1787383180.235945:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787383180.235951:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979558016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383180.236087:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979558016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.236094:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787383180.236130:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383180.238857:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8437:1874206979558144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383180.238971:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.238999:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558144 00000100:00100000:2.0:1787383180.239006:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558144 00000100:00100000:1.0:1787383180.239007:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc34e9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.239045:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787383180.239053:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:8437:x1874206979558144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383180.239291:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:8437:x1874206979558144:12345-0@lo:502:llog_process_th.0 Request processed in 230us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.239299:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787383180.239894:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8437:1874206979558144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383180.239928:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383180.239938:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383180.239941:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787383180.239950:0:8437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc2750b800 00000020:00000080:1.0:1787383180.239952:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787383180.240028:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8437:1874206979558272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383180.240820:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383180.240855:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc34e9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.240860:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558272 00000100:00100000:2.0:1787383180.240884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558272 00000100:00100000:2.0:1787383180.240923:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787383180.240930:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:8437:x1874206979558272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383180.241114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:8437:x1874206979558272:12345-0@lo:502:llog_process_th.0 Request processed in 183us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.241122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787383180.242677:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:8437:1874206979558272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383180.242733:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383180.242742:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383180.242744:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787383180.242759:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787383180.243393:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787383180.243418:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383180.243430:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.243442:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383180.557132:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383180.557159:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979558400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383180.557235:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.557520:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558400 00000100:00100000:2.0:1787383180.557529:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558400 00000100:00100000:2.0:1787383180.557586:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383180.557595:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979558400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383180.557632:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383180.557680:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979558400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.557687:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787383180.558499:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d628380 x1874206979558400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383180.558522:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979558400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383180.786985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383180.787072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383180.787116:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752128 00000100:00100000:1.0:1787383180.787126:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752128 00000100:00100000:1.0:1787383180.787195:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383180.787206:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:2.0:1787383180.787244:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383180.787288:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383180.787295:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1787383180.787663:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962751872 00000100:00100000:0.0:1787383180.787674:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962751872 00000100:00100000:0.0:1787383180.789029:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:0.0:1787383180.789041:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962751872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383180.789098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962751872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 59us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.789106:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1787383180.791103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383180.791252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383180.791412:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752000 00000100:00100000:3.0:1787383180.791420:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752000 00000100:00100000:3.0:1787383180.791483:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383180.791492:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962752000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383180.791560:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962752000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383180.791567:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00080000:1.0:1787383180.792312:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383180.794518:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752256 00000100:00100000:0.0:1787383180.794535:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752256 00000100:00100000:0.0:1787383180.794614:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1787383180.794625:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1787383180.794642:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383180.794708:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.794716:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00010000:00010000:3.0:1787383181.135676:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383182.154087:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383183.178021:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383184.202028:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383184.655062:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979558528:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655134:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655177:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979559040:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655233:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383184.655240:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979558912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655289:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979558656:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655328:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979559168:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655365:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383184.655370:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979558784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655389:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383184.655419:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559040 00000100:00100000:3.0:1787383184.655426:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559040 00000100:00100000:3.0:1787383184.655473:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558656 00000100:00100000:3.0:1787383184.655476:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558656 00000100:00100000:3.0:1787383184.655491:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558784 00000100:00100000:3.0:1787383184.655494:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558784 00000100:00100000:3.0:1787383184.655509:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383184.655517:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655577:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979559040:12345-0@lo:400:kworker.0 Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383184.655585:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383184.655603:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383184.655610:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979558656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655637:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979558656:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383184.655643:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383184.655653:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383184.655659:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979558784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655685:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979558784:12345-0@lo:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383184.655690:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383184.655720:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558912 00000100:00100000:3.0:1787383184.655724:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558912 00000100:00100000:3.0:1787383184.655747:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559168 00000100:00100000:3.0:1787383184.655750:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559168 00000100:00100000:3.0:1787383184.655764:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383184.655769:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979558912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655798:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979558912:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383184.655803:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383184.655813:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383184.655818:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979559168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655839:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979559168:12345-0@lo:400:kworker.0 Request processed in 22us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383184.655854:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787383184.655897:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383184.655901:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383184.655904:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383184.655931:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c952680 x1874206979558912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383184.655944:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979558912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655956:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979559040:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655987:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979558784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383184.655995:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979558656:0@lo:400:kworker.0 00010000:00080000:3.0:1787383184.656004:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c950e00 x1874206979559168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383184.656013:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979559168:0@lo:400:kworker.0 00000100:00100000:2.0:1787383184.656146:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979558528 00000100:00100000:2.0:1787383184.656151:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979558528 00000100:00100000:2.0:1787383184.656178:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787383184.656184:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979558528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383184.656220:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979558528:12345-0@lo:400:kworker.0 Request processed in 37us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383184.656226:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787383184.656266:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979558528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383185.162150:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383185.162175:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979559296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383185.162253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383185.162427:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559296 00000100:00100000:3.0:1787383185.162436:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559296 00000100:00100000:3.0:1787383185.162499:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787383185.162509:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979559296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383185.162546:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383185.162598:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979559296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383185.162605:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787383185.162649:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c950e00 x1874206979559296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383185.162683:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979559296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383185.234185:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383185.257978:0:8668:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787383185.674322:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383185.674347:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979559424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383185.674417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383185.674675:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559424 00000100:00100000:0.0:1787383185.674684:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559424 00000100:00100000:0.0:1787383185.674745:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383185.674754:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979559424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383185.674788:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383185.674843:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979559424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383185.674849:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787383185.675359:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d62a680 x1874206979559424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383185.675380:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979559424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383185.911387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383185.911468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383185.911499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383185.911543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383185.912020:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752512 00000100:00100000:2.0:1787383185.912030:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752512 00000100:00100000:2.0:1787383185.912099:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1787383185.912108:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962752512:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383185.912181:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962752512:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 74us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383185.912188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00080000:1.0:1787383185.912789:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383185.912940:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752640 00000100:00100000:3.0:1787383185.912948:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752640 00000100:00100000:3.0:1787383185.913016:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752768 00000100:00100000:3.0:1787383185.913020:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752768 00000100:00100000:3.0:1787383185.913040:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383185.913049:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752640:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383185.913097:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752640:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 50us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383185.913104:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383185.913117:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1787383185.913124:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752768:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383185.913149:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962752768:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383185.913155:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:1.0:1787383185.913361:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383185.913364:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383185.917355:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752384 00000100:00100000:0.0:1787383185.917370:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752384 00000100:00100000:0.0:1787383185.917506:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:0.0:1787383185.917517:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962752384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383185.917603:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962752384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 89us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383185.917624:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00010000:00010000:0.0:1787383186.252399:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383187.273964:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383188.303345:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383189.323074:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383189.770521:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979559808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383189.770600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.770653:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383189.770669:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979559680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383189.770694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.770712:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979560192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383189.770738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.772605:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979559552:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.772701:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.772751:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979560064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.772778:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.772807:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383189.772829:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979559936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.772854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.772913:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559808 00000100:00100000:3.0:1787383189.772922:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559808 00000100:00100000:3.0:1787383189.772970:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559680 00000100:00100000:3.0:1787383189.772973:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559680 00000100:00100000:3.0:1787383189.772990:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560064 00000100:00100000:3.0:1787383189.772992:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560064 00000100:00100000:3.0:1787383189.773008:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383189.773016:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979559808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.773069:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979559808:12345-0@lo:400:kworker.0 Request processed in 54us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.773090:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383189.773108:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383189.773114:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979559680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.773141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979559680:12345-0@lo:400:kworker.0 Request processed in 27us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.773147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383189.773156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383189.773162:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.773189:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979560064:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.773195:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383189.773215:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560192 00000100:00100000:3.0:1787383189.773219:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560192 00000100:00100000:3.0:1787383189.773252:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559936 00000100:00100000:3.0:1787383189.773256:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559936 00000100:00100000:0.0:1787383189.773398:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979559552 00000100:00100000:0.0:1787383189.773402:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979559552 00000100:00100000:0.0:1787383189.773430:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787383189.773437:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979559552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383189.773469:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979559552:12345-0@lo:400:kworker.0 Request processed in 32us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.773475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787383189.773584:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383189.773593:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383189.773627:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979560192:12345-0@lo:400:kworker.0 Request processed in 37us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383189.773633:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383189.773645:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383189.773651:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383189.773689:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979559936:12345-0@lo:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383189.773695:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787383189.776825:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383189.776849:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383189.776852:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383189.776918:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b7800 x1874206979559936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.776935:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979559936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.776947:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979559552:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.776959:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979560064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.777249:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979559680:0@lo:400:kworker.0 00010000:00080000:3.0:1787383189.777262:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b4380 x1874206979560192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.777271:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979560192:0@lo:400:kworker.0 00000100:00100000:3.0:1787383189.777283:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979559808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383190.286193:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383190.286233:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979560320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383190.286311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383190.286379:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560320 00000100:00100000:0.0:1787383190.286390:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560320 00000100:00100000:0.0:1787383190.286439:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383190.286449:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979560320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383190.286484:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383190.286526:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979560320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383190.286550:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787383190.286601:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b6a00 x1874206979560320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383190.286618:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979560320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383190.347958:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383190.797596:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979560448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383190.797677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383190.797757:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560448 00000100:00100000:1.0:1787383190.797766:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560448 00000100:00100000:1.0:1787383190.797815:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383190.797824:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979560448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383190.797857:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383190.797931:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979560448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383190.797939:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787383190.797980:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d62a300 x1874206979560448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383190.797998:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979560448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383191.043724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383191.043768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383191.043800:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383191.043826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383191.043852:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753152 00000100:00100000:3.0:1787383191.043861:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753152 00000100:00100000:3.0:1787383191.043947:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753280 00000100:00100000:3.0:1787383191.043951:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753280 00000100:00100000:3.0:1787383191.043969:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383191.043978:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2347:x1874206962753152:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1787383191.044015:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea6a 00000100:00080000:3.0:1787383191.044045:0:6601:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383191.044085:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787383191.044207:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753024 00000100:00100000:1.0:1787383191.044218:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753024 00000100:00100000:1.0:1787383191.044253:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1787383191.044261:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962753024:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383191.044330:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962753024:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383191.044339:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1787383191.045255:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962752896 00000100:00100000:0.0:1787383191.045263:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962752896 00000100:00100000:0.0:1787383191.045299:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:0.0:1787383191.045308:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962752896:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383191.045352:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962752896:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383191.045359:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00080000:0.0:1787383191.046293:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383191.046301:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383191.046303:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383191.046742:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+2:2347:x1874206962753152:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 2759us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383191.046754:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383191.046775:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1787383191.046784:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2347:x1874206962753280:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1787383191.046808:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea71 00000100:00080000:3.0:1787383191.046820:0:6601:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383191.047070:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787383191.049425:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+2:2347:x1874206962753280:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 2632us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383191.049440:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00010000:00010000:0.0:1787383191.050705:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383191.050821:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383191.338253:0:8912:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing yml_node 00010000:00010000:0.0:1787383191.371131:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383192.395018:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383193.418215:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383194.099982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383194.100033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383194.100154:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753536 00000100:00100000:3.0:1787383194.100165:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753536 00000100:00100000:3.0:1787383194.100256:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1787383194.100271:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962753536:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383194.100349:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962753536:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383194.100357:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1787383194.100551:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753408 00000100:00100000:0.0:1787383194.100556:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753408 00000100:00100000:0.0:1787383194.100595:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:0.0:1787383194.100602:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962753408:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383194.100643:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962753408:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383194.100650:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00080000:1.0:1787383194.101320:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383194.442039:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383194.893384:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979560960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.893521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383194.893602:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383194.893609:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979560576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.893654:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383194.893988:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979561088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.894024:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383194.894057:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979560704:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.894083:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383194.894102:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979561216:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.894124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383194.894145:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383194.894150:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979560832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383194.894172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383194.896234:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560576 00000100:00100000:0.0:1787383194.896261:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560576 00000100:00100000:0.0:1787383194.896328:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787383194.896338:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979560576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383194.896441:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979560576:12345-0@lo:400:kworker.0 Request processed in 104us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383194.896449:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787383194.896508:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560960 00000100:00100000:0.0:1787383194.896513:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560960 00000100:00100000:0.0:1787383194.896555:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561216 00000100:00100000:0.0:1787383194.896558:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561216 00000100:00100000:0.0:1787383194.896573:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383194.896578:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979560960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383194.896625:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979560960:12345-0@lo:400:kworker.0 Request processed in 34us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383194.896632:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383194.896644:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383194.896649:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979561216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383194.896691:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979561216:12345-0@lo:400:kworker.0 Request processed in 42us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383194.896697:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787383194.896725:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383194.896730:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383194.896769:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979560576:0@lo:400:kworker.0 00010000:00080000:0.0:1787383194.896791:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c850e00 x1874206979560960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383194.896804:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979560960:0@lo:400:kworker.0 00010000:00080000:2.0:1787383194.897945:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c852300 x1874206979561216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383194.897963:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979561216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383194.898447:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561088 00000100:00100000:0.0:1787383194.898456:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561088 00000100:00100000:1.0:1787383194.898578:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560704 00000100:00100000:1.0:1787383194.898584:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560704 00000100:00100000:1.0:1787383194.898633:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979560832 00000100:00100000:1.0:1787383194.898636:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979560832 00000100:00100000:1.0:1787383194.898657:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383194.898666:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979560704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383194.898755:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979560704:12345-0@lo:400:kworker.0 Request processed in 88us (4668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.898763:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383194.898782:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383194.898789:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979560832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383194.898819:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979560832:12345-0@lo:400:kworker.0 Request processed in 31us (4646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.898825:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383194.898879:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979560832:0@lo:400:kworker.0 00000100:00100000:1.0:1787383194.898893:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979560704:0@lo:400:kworker.0 00000100:00080000:1.0:1787383194.898967:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383194.899097:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383194.899106:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979561088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383194.899153:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979561088:12345-0@lo:400:kworker.0 Request processed in 50us (5129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383194.899159:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383194.899206:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979561088:0@lo:400:kworker.0 00000001:00100000:1.0:1787383194.961800:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:1.0:1787383194.961811:0:6624:0:(genops.c:906:class_export_put()) final put ffff9ffb0199c000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:3.0:1787383194.961854:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb0199c000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-OST0000 00000020:00000080:3.0:1787383194.962011:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffb0199f000 for lustre-OST0000 00000100:00100000:0.0:1787383195.406995:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979561344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383195.407065:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383195.407140:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561344 00000100:00100000:0.0:1787383195.407161:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561344 00000100:00100000:0.0:1787383195.407217:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383195.407226:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979561344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383195.407261:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383195.407304:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979561344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383195.407323:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787383195.407701:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b6a00 x1874206979561344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383195.407726:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979561344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383195.470502:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383195.528999:0:9105:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.114 00000001:00100000:1.0:1787383195.533799:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:1.0:1787383195.533807:0:7504:0:(genops.c:906:class_export_put()) final put ffff9ffb01999000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:0.0:1787383195.533888:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb01999000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-OST0001 00000020:00000080:0.0:1787383195.533939:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffb0199a800 for lustre-OST0001 00000100:00100000:0.0:1787383195.916482:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383195.916559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383195.917086:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561472 00000100:00100000:1.0:1787383195.917094:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561472 00000100:00100000:1.0:1787383195.917134:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383195.917143:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979561472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383195.917188:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383195.917234:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979561472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383195.917242:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787383195.917395:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d62ad80 x1874206979561472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383195.917413:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383196.153218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383196.153266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383196.153295:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753792 00000100:00100000:2.0:1787383196.153305:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753792 00000100:00100000:2.0:1787383196.153358:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1787383196.153367:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962753792:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383196.153435:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962753792:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383196.153443:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00080000:2.0:1787383196.153478:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383196.153634:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753664 00000100:00100000:0.0:1787383196.153639:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753664 00000100:00100000:0.0:1787383196.153677:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:0.0:1787383196.153685:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962753664:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383196.153721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962753664:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383196.153728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 197 00010000:00010000:2.0:1787383196.490064:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383197.515635:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383197.999075:0:9203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.114 00010000:00010000:2.0:1787383198.538058:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383199.562662:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383200.010663:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979561984:0@lo:400:kworker.0 00000100:00100000:0.0:1787383200.010737:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383200.010803:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787383200.010818:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979561856:0@lo:400:kworker.0 00000100:00100000:0.0:1787383200.010821:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979561600:0@lo:400:kworker.0 00000100:00100000:0.0:1787383200.010887:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383200.010891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383200.010915:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979562112:0@lo:400:kworker.0 00000100:00100000:3.0:1787383200.010938:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383200.010945:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383200.010949:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979561728:0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.011068:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561856 00000100:00100000:1.0:1787383200.011075:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561856 00000100:00100000:1.0:1787383200.011125:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562112 00000100:00100000:1.0:1787383200.011128:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562112 00000100:00100000:1.0:1787383200.011154:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383200.011164:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979561856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383200.011368:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383200.011378:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979562112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383200.021669:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383200.021712:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979562240:0@lo:400:kworker.0 00000100:00100000:3.0:1787383200.021753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383200.021799:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561984 00000100:00100000:3.0:1787383200.021806:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561984 00000100:00100000:3.0:1787383200.021862:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562240 00000100:00100000:3.0:1787383200.021881:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562240 00000100:00100000:3.0:1787383200.021901:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383200.021913:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979561984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383200.021964:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979561984:12345-0@lo:400:kworker.0 Request processed in 55us (11227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383200.021971:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383200.021986:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383200.021992:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979562240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383200.022022:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979562240:12345-0@lo:400:kworker.0 Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383200.022028:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787383200.022062:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b7800 x1874206979562240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383200.022091:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979562240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.024159:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979561856:12345-0@lo:400:kworker.0 Request processed in 12989us (13284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383200.024176:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383200.024233:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979561856:0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.024264:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561728 00000100:00100000:1.0:1787383200.024269:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561728 00000100:00100000:1.0:1787383200.024298:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383200.024305:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979561728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.024364:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979561728:12345-0@lo:400:kworker.0 Request processed in 59us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383200.024371:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383200.024395:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979561728:0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.024442:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979561600 00000100:00100000:1.0:1787383200.024445:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979561600 00000100:00100000:1.0:1787383200.024477:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787383200.024483:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979561600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.024515:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979561600:12345-0@lo:400:kworker.0 Request processed in 32us (13650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383200.024521:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1787383200.024594:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383200.024599:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383200.024603:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787383200.028456:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b4000 x1874206979561984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383200.028472:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979561984:0@lo:400:kworker.0 00000100:00100000:0.0:1787383200.028502:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979561600:0@lo:400:kworker.0 00000100:00100000:2.0:1787383200.031844:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979562112:12345-0@lo:400:kworker.0 Request processed in 20462us (20893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383200.031859:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383200.031944:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979562112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383200.523443:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979562368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383200.523532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383200.523617:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562368 00000100:00100000:1.0:1787383200.523624:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562368 00000100:00100000:1.0:1787383200.523668:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383200.523678:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979562368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383200.523715:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383200.523763:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979562368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383200.523770:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787383200.523815:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d629880 x1874206979562368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383200.523846:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979562368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383200.586056:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383200.611331:0:9302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.114 00000100:00100000:0.0:1787383201.036371:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979562496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383201.036442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383201.036522:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562496 00000100:00100000:0.0:1787383201.036529:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562496 00000100:00100000:0.0:1787383201.036586:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383201.036595:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979562496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383201.036631:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383201.036675:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979562496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383201.036682:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787383201.037019:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d629880 x1874206979562496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383201.037034:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979562496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383201.272373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383201.272426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383201.272524:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754048 00000100:00100000:1.0:1787383201.272536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754048 00000100:00100000:1.0:1787383201.272623:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1787383201.272634:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962754048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383201.272712:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962754048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383201.272719:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1787383201.273095:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962753920 00000100:00100000:0.0:1787383201.273100:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962753920 00000100:00100000:0.0:1787383201.273140:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:0.0:1787383201.273148:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962753920:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383201.273193:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2348:x1874206962753920:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383201.273200:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00080000:2.0:1787383201.273429:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383201.610456:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383202.452072:0:9351:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 03:20:01 EDT 2026 00010000:00010000:2.0:1787383202.636089:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383203.665302:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383204.681997:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383205.131278:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383205.131303:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979562624:0@lo:400:kworker.0 00000100:00100000:3.0:1787383205.131316:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979562752:0@lo:400:kworker.0 00000100:00100000:2.0:1787383205.131370:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979563136:0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.131430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383205.131478:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979563008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.131505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383205.131548:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562624 00000100:00100000:0.0:1787383205.131555:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562624 00000100:00100000:0.0:1787383205.131597:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787383205.131611:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.131659:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979562624:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383205.131667:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787383205.131710:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563008 00000100:00100000:0.0:1787383205.131714:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563008 00000100:00100000:0.0:1787383205.131755:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383205.131762:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.131795:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979563008:12345-0@lo:400:kworker.0 Request processed in 34us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383205.131801:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787383205.131842:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c953480 x1874206979563008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383205.131856:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979563008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.131865:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979562624:0@lo:400:kworker.0 00000100:00100000:3.0:1787383205.135367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.135436:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979563264:0@lo:400:kworker.0 00000100:00100000:3.0:1787383205.135486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.135545:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383205.135553:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979562880:0@lo:400:kworker.0 00000100:00100000:3.0:1787383205.135580:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.135630:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563264 00000100:00100000:3.0:1787383205.135638:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563264 00000100:00100000:3.0:1787383205.135691:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383205.135701:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979563264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383205.137291:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562752 00000100:00100000:1.0:1787383205.137304:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562752 00000100:00100000:1.0:1787383205.137370:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979562880 00000100:00100000:1.0:1787383205.137374:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979562880 00000100:00100000:1.0:1787383205.137402:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383205.137413:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979562752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383205.137488:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979562752:12345-0@lo:400:kworker.0 Request processed in 77us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383205.137495:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383205.137512:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383205.137530:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979562880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383205.137559:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979562880:12345-0@lo:400:kworker.0 Request processed in 42us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383205.137578:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383205.138671:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979563264:12345-0@lo:400:kworker.0 Request processed in 2966us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.138683:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383205.138832:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979562880:0@lo:400:kworker.0 00000100:00100000:3.0:1787383205.138848:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979562752:0@lo:400:kworker.0 00010000:00080000:3.0:1787383205.138864:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b5880 x1874206979563264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.138948:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979563264:0@lo:400:kworker.0 00000100:00080000:3.0:1787383205.139606:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383205.139613:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383205.139616:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383205.140991:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383205.141259:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563136 00000100:00100000:0.0:1787383205.141268:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563136 00000100:00100000:0.0:1787383205.141333:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383205.141343:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383205.141418:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979563136:12345-0@lo:400:kworker.0 Request processed in 75us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383205.141425:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383205.141471:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979563136:0@lo:400:kworker.0 00000100:00080000:2.0:1787383205.141640:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383205.644269:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383205.644295:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979563392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383205.644366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383205.644445:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563392 00000100:00100000:2.0:1787383205.644453:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563392 00000100:00100000:2.0:1787383205.644497:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383205.644506:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979563392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383205.644550:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383205.644593:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979563392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383205.644606:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787383205.644654:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d716a00 x1874206979563392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383205.644686:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979563392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383205.707171:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383206.155832:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383206.158160:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979563520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383206.158248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383206.158385:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563520 00000100:00100000:2.0:1787383206.158394:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563520 00000100:00100000:2.0:1787383206.158443:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383206.158453:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979563520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383206.158490:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383206.158539:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979563520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383206.158545:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787383206.159911:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d715c00 x1874206979563520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383206.159935:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979563520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383206.394741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383206.394789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383206.394933:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754304 00000100:00100000:3.0:1787383206.394943:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754304 00000100:00100000:3.0:1787383206.395033:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:3.0:1787383206.395048:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383206.395132:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383206.395140:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1787383206.395180:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754176 00000100:00100000:1.0:1787383206.395184:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754176 00000100:00100000:1.0:1787383206.395211:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:1.0:1787383206.395217:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383206.395243:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383206.395250:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00080000:2.0:1787383206.395578:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383206.737199:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383207.759032:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383208.781694:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383209.803162:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383210.252548:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979564032:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.252648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383210.252849:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564032 00000100:00100000:0.0:1787383210.252860:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564032 00000100:00100000:0.0:1787383210.252986:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383210.252999:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979564032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383210.253560:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979564032:12345-0@lo:400:kworker.0 Request processed in 561us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383210.253571:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787383210.254329:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d628000 x1874206979564032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383210.254350:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979564032:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.254380:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383210.254393:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979563648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.254450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.254498:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979564160:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.254528:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.254568:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979563776:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.254630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.254666:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979564288:0@lo:400:kworker.0 00000100:00080000:0.0:1787383210.256588:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383210.256633:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563648 00000100:00100000:0.0:1787383210.256647:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563648 00000100:00100000:1.0:1787383210.257336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.257393:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383210.257407:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979563904:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.257458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.257520:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564160 00000100:00100000:1.0:1787383210.257526:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564160 00000100:00100000:1.0:1787383210.257592:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563776 00000100:00100000:1.0:1787383210.257596:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563776 00000100:00100000:1.0:1787383210.257614:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979563904 00000100:00100000:1.0:1787383210.257617:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979563904 00000100:00100000:1.0:1787383210.257649:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787383210.257661:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979564160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383210.257995:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564288 00000100:00100000:3.0:1787383210.258011:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564288 00000100:00100000:3.0:1787383210.258142:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383210.258154:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979564288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383210.258253:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979564288:12345-0@lo:400:kworker.0 Request processed in 102us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383210.258261:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383210.258295:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383210.258307:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979563776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383210.258364:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979563776:12345-0@lo:400:kworker.0 Request processed in 62us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383210.258371:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383210.258385:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383210.258392:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979563904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383210.258421:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979563904:12345-0@lo:400:kworker.0 Request processed in 30us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383210.258426:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383210.258517:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979563904:0@lo:400:kworker.0 00000100:00100000:3.0:1787383210.258529:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979563776:0@lo:400:kworker.0 00010000:00080000:3.0:1787383210.258657:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d62a680 x1874206979564288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383210.258667:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979564288:0@lo:400:kworker.0 00000100:00100000:0.0:1787383210.258856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787383210.258896:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979563648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383210.258987:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979563648:12345-0@lo:400:kworker.0 Request processed in 108us (4523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383210.258995:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1787383210.259810:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383210.259820:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383210.259887:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979563648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.259986:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979564160:12345-0@lo:400:kworker.0 Request processed in 2327us (5456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383210.259996:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787383210.260036:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979564160:0@lo:400:kworker.0 00000100:00100000:1.0:1787383210.763120:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979564416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383210.763220:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383210.763316:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564416 00000100:00100000:1.0:1787383210.763327:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564416 00000100:00100000:1.0:1787383210.763389:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383210.763400:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979564416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383210.763448:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383210.763516:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979564416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383210.763525:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787383210.763580:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b1f80 x1874206979564416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383210.763624:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979564416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383210.837295:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383211.280318:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383211.280342:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979564544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383211.280407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383211.280478:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564544 00000100:00100000:0.0:1787383211.280485:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564544 00000100:00100000:0.0:1787383211.280531:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383211.280540:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979564544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383211.280574:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383211.280615:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979564544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383211.280622:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787383211.280675:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d714380 x1874206979564544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383211.280693:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979564544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383211.505115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383211.505226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383211.505310:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754432 00000100:00100000:0.0:1787383211.505322:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754432 00000100:00100000:0.0:1787383211.505378:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:0.0:1787383211.505388:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383211.505472:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383211.505480:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:2.0:1787383211.510232:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754560 00000100:00100000:2.0:1787383211.510246:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754560 00000100:00100000:2.0:1787383211.510315:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1787383211.510326:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383211.510410:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 85us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383211.510418:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00080000:1.0:1787383211.510824:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383211.850958:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383212.880588:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383213.898349:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383214.925767:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383215.370829:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979565056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.370924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383215.370979:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787383215.370986:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979564672:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.371013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383215.371036:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979565184:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.371060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383215.371087:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979564800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.371110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383215.371128:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979565312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.371147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383215.371164:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383215.371169:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979564928:0@lo:400:kworker.0 00000100:00100000:0.0:1787383215.371205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383215.371433:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565184 00000100:00100000:1.0:1787383215.371441:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565184 00000100:00100000:1.0:1787383215.371488:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564800 00000100:00100000:1.0:1787383215.371491:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564800 00000100:00100000:1.0:1787383215.371502:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564928 00000100:00100000:1.0:1787383215.371505:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564928 00000100:00100000:1.0:1787383215.371518:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383215.371527:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979565184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371583:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979565184:12345-0@lo:400:kworker.0 Request processed in 57us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.371590:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383215.371608:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383215.371614:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979564800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371642:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979564800:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.371648:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383215.371659:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383215.371664:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979564928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371687:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979564928:12345-0@lo:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.371693:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383215.371710:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979564672 00000100:00100000:1.0:1787383215.371713:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979564672 00000100:00100000:1.0:1787383215.371743:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787383215.371749:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979564672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371776:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979564672:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.371782:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1787383215.371804:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383215.371838:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979564928:0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371847:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979564800:0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371893:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979564672:0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371903:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979565184:0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.371927:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565056 00000100:00100000:1.0:1787383215.371930:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565056 00000100:00100000:1.0:1787383215.371957:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565312 00000100:00100000:1.0:1787383215.371960:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565312 00000100:00100000:1.0:1787383215.371977:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383215.371983:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.372015:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979565056:12345-0@lo:400:kworker.0 Request processed in 32us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.372021:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383215.372031:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383215.372036:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979565312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.372064:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979565312:12345-0@lo:400:kworker.0 Request processed in 27us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383215.372070:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787383215.372086:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383215.372097:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787383215.372118:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c951180 x1874206979565312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383215.372128:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979565312:0@lo:400:kworker.0 00010000:00080000:1.0:1787383215.372152:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d715c00 x1874206979565056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383215.372160:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979565056:0@lo:400:kworker.0 00000100:00100000:1.0:1787383215.882922:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979565440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383215.883025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383215.883177:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565440 00000100:00100000:2.0:1787383215.883189:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565440 00000100:00100000:2.0:1787383215.883269:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383215.883281:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979565440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383215.883344:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383215.883405:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979565440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383215.883414:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787383215.884403:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c850a80 x1874206979565440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383215.884439:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979565440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787383215.946077:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383216.394351:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979565568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383216.394441:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383216.394776:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565568 00000100:00100000:0.0:1787383216.394785:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565568 00000100:00100000:0.0:1787383216.394839:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383216.394848:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979565568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383216.395001:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383216.395055:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979565568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383216.395062:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787383216.395134:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c86a300 x1874206979565568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383216.395153:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979565568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383216.624661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383216.624751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383216.624846:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754688 00000100:00100000:2.0:1787383216.624855:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754688 00000100:00100000:1.0:1787383216.624940:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754816 00000100:00100000:1.0:1787383216.624944:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754816 00000100:00100000:2.0:1787383216.625036:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:2.0:1787383216.625043:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383216.625097:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2350:x1874206962754688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 55us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383216.625102:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:1.0:1787383216.625550:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1787383216.625556:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383216.625592:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962754816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383216.625597:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:3.0:1787383216.627823:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383216.970630:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383217.916356:0:9981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:20:16 (1787383216) === 00010000:00010000:1.0:1787383217.995963:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383218.318588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.318708:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962754944 00000100:00100000:1.0:1787383218.318740:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962754944 00000100:00100000:1.0:1787383218.318803:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:1.0:1787383218.318814:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:8099:x1874206962754944:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383218.318833:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383218.318853:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc00031200/0x42020b050d5ceb35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b053 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.318923:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc00031200/0x42020b050d5ceb35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b053 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.318937:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc00031200/0x42020b050d5ceb35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b053 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.318947:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc00031200, rc 0) 00000100:00100000:1.0:1787383218.319002:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962754944:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 190us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.319010:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:2.0:1787383218.320818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383218.320972:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755072 00000100:00100000:0.0:1787383218.320984:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755072 00000100:00100000:0.0:1787383218.321054:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:0.0:1787383218.321065:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962755072:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383218.321381:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962755072:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 317us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.321389:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:2.0:1787383218.325433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.325598:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755200 00000100:00100000:1.0:1787383218.325607:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755200 00000100:00100000:1.0:1787383218.325660:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:1.0:1787383218.325671:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962755200:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383218.326128:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962755200:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 457us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.326137:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:1.0:1787383218.329793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383218.329908:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755328 00000100:00100000:2.0:1787383218.329919:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755328 00000100:00100000:2.0:1787383218.329981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:2.0:1787383218.329991:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8103:x1874206962755328:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383218.330257:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8103:x1874206962755328:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 267us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.330267:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:2.0:1787383218.373032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383218.373130:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755456 00000100:00100000:0.0:1787383218.373140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755456 00000100:00100000:0.0:1787383218.373193:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:0.0:1787383218.373203:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8103:x1874206962755456:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383218.373507:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8103:x1874206962755456:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 304us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.373522:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:3.0:1787383218.377833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.378456:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755584 00000100:00100000:1.0:1787383218.378469:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755584 00000100:00100000:1.0:1787383218.378544:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1787383218.378554:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:8099:x1874206962755584:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383218.378570:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383218.378590:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc00031400/0x42020b050d5ceb3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b07d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.378617:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc00031400/0x42020b050d5ceb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b07d expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.378628:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc00031400/0x42020b050d5ceb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b07d expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383218.378637:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc00031400, rc 0) 00000100:00100000:1.0:1787383218.378698:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:8099:x1874206962755584:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 145us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.378705:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1787383218.385412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383218.385635:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755712 00000100:00100000:2.0:1787383218.385646:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755712 00000100:00100000:2.0:1787383218.385703:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:2.0:1787383218.385714:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:8099:x1874206962755712:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787383218.386331:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787383218.386352:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787383218.386356:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787383218.386360:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787383218.386362:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787383218.390514:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:8099:x1874206962755712:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 4791us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.390529:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:3.0:1787383218.402773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383218.403605:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755840 00000100:00100000:0.0:1787383218.403617:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755840 00000100:00100000:0.0:1787383218.403685:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:0.0:1787383218.403707:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:8099:x1874206962755840:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787383218.403724:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383218.403741:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b084 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383218.403769:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383218.403779:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383218.403788:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046a00, rc 0) 00000100:00100000:0.0:1787383218.403853:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8099:x1874206962755840:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 159us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.403860:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:1.0:1787383218.410732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383218.410841:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962755968 00000100:00100000:0.0:1787383218.410851:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962755968 00000100:00100000:0.0:1787383218.410933:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:0.0:1787383218.410944:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8099:x1874206962755968:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383218.411252:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8099:x1874206962755968:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 308us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.411261:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:2.0:1787383218.416861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.419678:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756096 00000100:00100000:1.0:1787383218.419693:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756096 00000100:00100000:1.0:1787383218.419762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:1.0:1787383218.419773:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8099:x1874206962756096:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383218.420380:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8099:x1874206962756096:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 607us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.420390:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:3.0:1787383218.431186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.431409:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756224 00000100:00100000:1.0:1787383218.431419:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756224 00000100:00100000:1.0:1787383218.431487:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:1.0:1787383218.431496:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8106:x1874206962756224:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383218.431713:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8106:x1874206962756224:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 217us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.431721:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:0.0:1787383218.442619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383218.442710:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756352 00000100:00100000:1.0:1787383218.442720:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756352 00000100:00100000:1.0:1787383218.442777:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:1.0:1787383218.442786:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8106:x1874206962756352:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383218.443175:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:8106:x1874206962756352:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 388us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.443183:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:3.0:1787383218.454141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383218.454182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383218.454449:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756480 00000100:00100000:2.0:1787383218.454460:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756480 00000100:00100000:2.0:1787383218.454501:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756608 00000100:00100000:2.0:1787383218.454504:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756608 00000100:00100000:2.0:1787383218.454558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1787383218.454569:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962756608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383218.454638:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962756608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.454647:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1787383218.454666:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1787383218.454670:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1874206962756480:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383218.454692:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7f7d4d88-92fa-41ed-9228-fa6a1116f23d@192.168.202.19@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1787383218.454738:0:5803:0:(genops.c:1406:class_connect()) connect: client 7f7d4d88-92fa-41ed-9228-fa6a1116f23d, cookie 0x42020b050d5ceb4a 00000004:00100000:2.0:1787383218.454770:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383218.455058:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb21800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383218.455087:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2347:x1874206962756480:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 415us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.455095:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:0.0:1787383218.456595:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383218.461531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383218.461607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383218.462111:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756736 00000100:00100000:0.0:1787383218.462123:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756736 00000100:00100000:0.0:1787383218.462190:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756864 00000100:00100000:0.0:1787383218.462193:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756864 00000100:00100000:0.0:1787383218.462211:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1787383218.462220:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+7:0:x1874206962756736:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383218.462266:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787383218.462349:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+7:0:x1874206962756736:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 129us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.462357:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1787383218.462372:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1787383218.462378:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962756864:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383218.462387:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787383218.462415:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962756864:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 37us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.462421:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00080000:3.0:1787383218.462484:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383218.463951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383218.464079:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962756992 00000100:00100000:2.0:1787383218.464087:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962756992 00000100:00100000:2.0:1787383218.464149:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383218.464159:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962756992:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787383218.464233:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962756992:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.464240:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383218.467183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383218.467295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383218.467337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383218.470743:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757120 00000100:00100000:2.0:1787383218.470761:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757120 00000100:00100000:2.0:1787383218.470814:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757248 00000100:00100000:2.0:1787383218.470818:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757248 00000100:00100000:2.0:1787383218.470836:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383218.470844:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1874206962757120:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383218.470918:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7f7d4d88-92fa-41ed-9228-fa6a1116f23d@192.168.202.19@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1787383218.470953:0:6600:0:(genops.c:1406:class_connect()) connect: client 7f7d4d88-92fa-41ed-9228-fa6a1116f23d, cookie 0x42020b050d5ceb51 00002000:00100000:2.0:1787383218.470973:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f7d4d88-92fa-41ed-9228-fa6a1116f23d/ffff9ffc3cb23800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383218.471000:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383218.471214:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383218.471245:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb22000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383218.471540:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2347:x1874206962757120:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 696us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.471548:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383218.471574:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383218.471579:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1874206962757248:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383218.471595:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7f7d4d88-92fa-41ed-9228-fa6a1116f23d@192.168.202.19@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1787383218.471613:0:6600:0:(genops.c:1406:class_connect()) connect: client 7f7d4d88-92fa-41ed-9228-fa6a1116f23d, cookie 0x42020b050d5ceb58 00002000:00100000:2.0:1787383218.471618:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f7d4d88-92fa-41ed-9228-fa6a1116f23d/ffff9ffc3cb20000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383218.471645:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383218.472679:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383218.472705:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383218.473311:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2347:x1874206962757248:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 1727us (5970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.474104:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1787383218.480852:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757376 00000100:00100000:1.0:1787383218.480880:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757376 00000100:00100000:1.0:1787383218.480947:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1787383218.480958:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962757376:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787383218.481211:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787383218.481690:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:8099:x1874206962757376:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 733us (14515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.481700:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00010000:00010000:0.0:1787383219.018255:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383220.042754:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383220.494694:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383220.494717:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979565696:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.494804:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.494893:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565696 00000100:00100000:3.0:1787383220.494902:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565696 00000100:00100000:3.0:1787383220.494966:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787383220.494977:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979565696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495033:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979565696:12345-0@lo:400:kworker.0 Request processed in 57us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383220.495040:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787383220.495086:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979565696:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495126:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979565824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.495205:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565824 00000100:00100000:3.0:1787383220.495209:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565824 00000100:00100000:3.0:1787383220.495238:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383220.495245:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495284:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979565824:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383220.495290:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383220.495683:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979565824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495727:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979565952:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.495783:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979565952 00000100:00100000:3.0:1787383220.495788:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979565952 00000100:00100000:3.0:1787383220.495820:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383220.495827:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979565952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.495896:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979565952:12345-0@lo:400:kworker.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383220.495903:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787383220.495919:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383220.496001:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979565952:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496040:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979566080:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.496100:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566080 00000100:00100000:3.0:1787383220.496105:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566080 00000100:00100000:3.0:1787383220.496135:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383220.496141:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496174:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979566080:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383220.496181:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787383220.496198:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383220.496215:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c826300 x1874206979566080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383220.496226:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979566080:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383220.496259:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979566208:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496282:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.496303:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566208 00000100:00100000:3.0:1787383220.496307:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566208 00000100:00100000:3.0:1787383220.496673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383220.496681:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496728:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979566208:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383220.496735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383220.496764:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979566208:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496800:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979566336:0@lo:400:kworker.0 00000100:00100000:3.0:1787383220.496823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383220.496853:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566336 00000100:00100000:3.0:1787383220.496856:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566336 00000100:00080000:1.0:1787383220.502890:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383220.502919:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383220.503297:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787383220.503325:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979566336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383220.503436:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979566336:12345-0@lo:400:kworker.0 Request processed in 128us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383220.503444:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787383220.503594:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c826300 x1874206979566336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383220.503611:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979566336:0@lo:400:kworker.0 00000001:00100000:2.0:1787383220.581065:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000100:00100000:2.0:1787383221.005630:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979566464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383221.006379:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383221.006454:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566464 00000100:00100000:1.0:1787383221.006462:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566464 00000100:00100000:1.0:1787383221.006508:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383221.006517:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979566464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383221.006583:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383221.006638:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979566464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383221.006646:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787383221.009453:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b2300 x1874206979566464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383221.009480:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979566464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383221.067707:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383221.092404:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000001:00100000:3.0:1787383221.102626:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000100:00100000:2.0:1787383221.517777:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383221.517800:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979566592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383221.518032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383221.519005:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566592 00000100:00100000:3.0:1787383221.519021:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566592 00000100:00100000:3.0:1787383221.519089:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383221.519099:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979566592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383221.519149:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383221.519216:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979566592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383221.519223:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787383221.519497:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c852a00 x1874206979566592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383221.519598:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979566592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383222.091508:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383223.114164:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383223.795743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383223.795788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383223.795812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383223.795846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383223.795958:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757504 00000100:00100000:3.0:1787383223.795970:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757504 00000100:00100000:3.0:1787383223.796038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:3.0:1787383223.796050:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962757504:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383223.796156:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962757504:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 108us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.796165:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:3.0:1787383223.796206:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757632 00000100:00100000:3.0:1787383223.796210:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757632 00000100:00100000:3.0:1787383223.796245:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757760 00000100:00100000:3.0:1787383223.796250:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757760 00000100:00100000:3.0:1787383223.796272:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1787383223.796280:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962757632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383223.796315:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962757632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.796322:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1787383223.796336:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1787383223.796356:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962757760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383223.796384:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962757760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.796391:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1787383223.796419:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758016 00000100:00100000:3.0:1787383223.796424:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758016 00000100:00100000:3.0:1787383223.796455:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:3.0:1787383223.796462:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962758016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383223.796491:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962758016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.796504:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00080000:1.0:1787383223.797965:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383223.797977:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383223.803036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383223.803392:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962757888 00000100:00100000:3.0:1787383223.803406:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962757888 00000100:00100000:3.0:1787383223.803490:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1787383223.803505:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962757888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383223.803585:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962757888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 87us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.803591:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00080000:1.0:1787383223.810152:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787383224.140434:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383224.338217:0:10178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787383225.164732:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383225.612216:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979566720:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612325:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612412:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979567232:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612478:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383225.612485:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979567104:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612550:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979566848:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612591:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979567360:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612628:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383225.612634:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979566976:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383225.612745:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566720 00000100:00100000:0.0:1787383225.612755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566720 00000100:00100000:0.0:1787383225.612814:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787383225.612825:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979566720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.612909:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979566720:12345-0@lo:400:kworker.0 Request processed in 85us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.612916:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787383225.612959:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567232 00000100:00100000:0.0:1787383225.612963:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567232 00000100:00100000:0.0:1787383225.613003:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566848 00000100:00100000:0.0:1787383225.613007:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566848 00000100:00100000:0.0:1787383225.613019:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979566976 00000100:00100000:0.0:1787383225.613021:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979566976 00000100:00100000:0.0:1787383225.613044:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383225.613050:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979567232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613092:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979567232:12345-0@lo:400:kworker.0 Request processed in 42us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.613099:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383225.613113:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383225.613119:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979566848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613152:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979566848:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.613157:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383225.613168:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383225.613173:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979566976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613199:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979566976:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.613204:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383225.613223:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567104 00000100:00100000:0.0:1787383225.613227:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567104 00000100:00100000:0.0:1787383225.613253:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567360 00000100:00100000:0.0:1787383225.613256:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567360 00000100:00100000:0.0:1787383225.613272:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787383225.613279:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979567104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613307:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979567104:12345-0@lo:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.613313:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787383225.613324:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383225.613341:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979567360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613371:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979567360:12345-0@lo:400:kworker.0 Request processed in 42us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.613386:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787383225.613420:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383225.613425:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383225.613427:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383225.613467:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979566976:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613479:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979566848:0@lo:400:kworker.0 00010000:00080000:0.0:1787383225.613492:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3cffc700 x1874206979567360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383225.613503:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979567360:0@lo:400:kworker.0 00010000:00080000:0.0:1787383225.613554:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c869880 x1874206979567104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383225.613562:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979567104:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613571:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979566720:0@lo:400:kworker.0 00000100:00100000:0.0:1787383225.613580:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979567232:0@lo:400:kworker.0 00000100:00100000:2.0:1787383226.125732:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979567488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383226.125844:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383226.125966:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567488 00000100:00100000:2.0:1787383226.125976:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567488 00000100:00100000:2.0:1787383226.126033:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383226.126043:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979567488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383226.126087:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383226.126149:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979567488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383226.126157:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787383226.126284:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b0700 x1874206979567488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383226.126308:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979567488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383226.198610:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383226.635439:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979567616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383226.635545:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383226.635642:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567616 00000100:00100000:2.0:1787383226.635652:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567616 00000100:00100000:2.0:1787383226.635712:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383226.635723:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979567616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383226.635774:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383226.635828:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979567616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383226.635835:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787383226.635914:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c851f80 x1874206979567616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383226.635936:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979567616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787383227.218471:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383228.246084:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383228.913487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383228.913599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383228.913632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383228.913675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383228.913718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383228.913780:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758272 00000100:00100000:3.0:1787383228.913794:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758272 00000100:00100000:3.0:1787383228.913913:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758400 00000100:00100000:3.0:1787383228.913917:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758400 00000100:00100000:3.0:1787383228.914025:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1787383228.914037:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962758272:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383228.914143:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962758272:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 100us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.914153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1787383228.914177:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1787383228.914209:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962758400:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383228.914251:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962758400:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.914258:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1787383228.914469:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758144 00000100:00100000:2.0:1787383228.914474:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758144 00000100:00100000:2.0:1787383228.914522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:2.0:1787383228.914530:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962758144:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383228.914569:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962758144:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.914583:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00080000:2.0:1787383228.914694:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383228.914715:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758656 00000100:00100000:2.0:1787383228.914720:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758656 00000100:00100000:2.0:1787383228.914768:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758528 00000100:00100000:2.0:1787383228.914771:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758528 00000100:00100000:2.0:1787383228.914798:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1787383228.914806:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962758656:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383228.914848:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962758656:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 43us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.914855:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1787383228.914901:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1787383228.914908:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962758528:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383228.915901:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962758528:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 987us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.915912:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00080000:2.0:1787383228.915968:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383228.915973:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787383229.258227:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383230.283721:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383230.732753:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979567744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383230.732842:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383230.733271:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979568128:0@lo:400:kworker.0 00000100:00100000:3.0:1787383230.733321:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383230.733563:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567744 00000100:00100000:0.0:1787383230.733571:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567744 00000100:00100000:0.0:1787383230.733616:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787383230.733626:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979567744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.733924:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979567872:0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.733958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383230.733981:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979568384:0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.734004:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383230.734025:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383230.734031:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979568000:0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.734052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383230.734084:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979567872 00000100:00100000:1.0:1787383230.734088:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979567872 00000100:00100000:0.0:1787383230.734256:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979567744:12345-0@lo:400:kworker.0 Request processed in 630us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383230.734265:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787383230.734359:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383230.734369:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979568256:0@lo:400:kworker.0 00000100:00100000:3.0:1787383230.734398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383230.734475:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568000 00000100:00100000:0.0:1787383230.734480:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568000 00000100:00080000:3.0:1787383230.734546:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383230.734661:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568256 00000100:00100000:1.0:1787383230.734666:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568256 00000100:00100000:3.0:1787383230.734727:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787383230.734735:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979567872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383230.734777:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979567872:12345-0@lo:400:kworker.0 Request processed in 43us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383230.734783:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383230.736556:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979567744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383230.736605:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568128 00000100:00100000:2.0:1787383230.736610:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568128 00000100:00100000:2.0:1787383230.736675:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568384 00000100:00100000:2.0:1787383230.736679:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568384 00000100:00100000:2.0:1787383230.736698:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383230.736706:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3505f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979568128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383230.737013:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787383230.737024:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979568000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383230.737095:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979568000:12345-0@lo:400:kworker.0 Request processed in 74us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383230.737115:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383230.737356:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3505f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979568128:12345-0@lo:400:kworker.0 Request processed in 650us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383230.737363:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383230.737511:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383230.737518:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383230.737547:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979568384:12345-0@lo:400:kworker.0 Request processed in 30us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383230.737552:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383230.741253:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787383230.741275:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979568256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.741389:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979568256:12345-0@lo:400:kworker.0 Request processed in 124us (6988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383230.741396:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787383230.741450:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383230.741455:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383230.741458:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383230.741500:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979568000:0@lo:400:kworker.0 00000100:00100000:1.0:1787383230.741513:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979567872:0@lo:400:kworker.0 00010000:00080000:1.0:1787383230.741527:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b3800 x1874206979568384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383230.741537:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979568384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383230.742931:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979568256:0@lo:400:kworker.0 00010000:00080000:0.0:1787383230.742949:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b0a80 x1874206979568128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383230.742960:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979568128:0@lo:400:kworker.0 00000100:00100000:1.0:1787383231.247484:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383231.247511:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979568512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383231.247585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383231.247673:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568512 00000100:00100000:1.0:1787383231.247681:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568512 00000100:00100000:1.0:1787383231.247730:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383231.247739:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979568512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383231.247772:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383231.247953:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979568512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383231.247960:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787383231.248004:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b3800 x1874206979568512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383231.248024:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979568512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787383231.306104:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383231.760711:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979568640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383231.760778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383231.761002:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568640 00000100:00100000:1.0:1787383231.761010:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568640 00000100:00100000:1.0:1787383231.761072:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383231.761081:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979568640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383231.761122:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383231.761164:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979568640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383231.761171:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787383231.761484:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3cffc700 x1874206979568640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383231.761502:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979568640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383232.330047:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383233.359284:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383234.031984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383234.032039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383234.032073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383234.032114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383234.032150:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759296 00000100:00100000:3.0:1787383234.032163:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759296 00000100:00100000:2.0:1787383234.032406:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758784 00000100:00100000:2.0:1787383234.032411:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758784 00000100:00100000:2.0:1787383234.032458:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:2.0:1787383234.032470:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962758784:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383234.032566:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962758784:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 97us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383234.032574:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00080000:2.0:1787383234.032645:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383234.032660:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759040 00000100:00100000:2.0:1787383234.032664:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759040 00000100:00100000:2.0:1787383234.032717:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962758912 00000100:00100000:2.0:1787383234.032720:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962758912 00000100:00100000:2.0:1787383234.032747:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1787383234.032755:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759040:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383234.032792:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383234.032800:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1787383234.032812:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1787383234.032819:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962758912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383234.032847:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962758912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383234.032854:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00080000:2.0:1787383234.032904:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383234.033397:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1787383234.033409:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759296:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383234.033453:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759296:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383234.033472:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1787383234.035577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383234.038496:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759168 00000100:00100000:1.0:1787383234.038519:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759168 00000100:00100000:1.0:1787383234.038620:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1787383234.038634:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759168:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383234.038747:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962759168:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 116us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383234.038769:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00080000:2.0:1787383234.039264:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787383234.383199:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383235.406848:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383235.854317:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979568768:0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.854392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383235.854437:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979569280:0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.854467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383235.854474:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979568896:0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.854500:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383235.854508:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979569152:0@lo:400:kworker.0 00000100:00100000:1.0:1787383235.854515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383235.854691:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568768 00000100:00100000:2.0:1787383235.854700:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568768 00000100:00100000:2.0:1787383235.854747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787383235.854757:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979568768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.861351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383235.861437:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569280 00000100:00100000:3.0:1787383235.861446:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569280 00000100:00100000:0.0:1787383235.861456:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569152 00000100:00100000:0.0:1787383235.861463:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569152 00000100:00100000:3.0:1787383235.861511:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979568896 00000100:00100000:3.0:1787383235.861515:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979568896 00000100:00100000:0.0:1787383235.861517:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383235.861530:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.861543:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787383235.861552:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383235.861606:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979569152:12345-0@lo:400:kworker.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383235.861613:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979569280:12345-0@lo:400:kworker.0 Request processed in 60us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383235.861619:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383235.861626:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787383235.861646:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383235.861653:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.861684:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979568896:12345-0@lo:400:kworker.0 Request processed in 32us (7172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383235.861690:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1787383235.861840:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c824000 x1874206979569152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383235.861863:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979569152:0@lo:400:kworker.0 00000100:00100000:3.0:1787383235.861894:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979569280:0@lo:400:kworker.0 00000100:00100000:1.0:1787383235.863427:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979568896:0@lo:400:kworker.0 00000100:00100000:1.0:1787383235.863443:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979569408:0@lo:400:kworker.0 00000100:00100000:1.0:1787383235.863496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383235.863541:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383235.863548:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979569024:0@lo:400:kworker.0 00000100:00100000:1.0:1787383235.863593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383235.863637:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569024 00000100:00100000:1.0:1787383235.863642:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569024 00000100:00100000:1.0:1787383235.864973:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383235.864982:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979568768:12345-0@lo:400:kworker.0 Request processed in 10223us (10586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383235.864992:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383235.864998:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787383235.865057:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979569024:12345-0@lo:400:kworker.0 Request processed in 71us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383235.865064:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787383235.865112:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383235.865119:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383235.865122:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979569024:0@lo:400:kworker.0 00000100:00100000:0.0:1787383235.871498:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569408 00000100:00100000:0.0:1787383235.871514:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569408 00000100:00100000:0.0:1787383235.871607:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383235.871618:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979569408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383235.871750:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979569408:12345-0@lo:400:kworker.0 Request processed in 133us (8252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383235.871759:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787383235.872168:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787383235.872925:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c825c00 x1874206979569408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383235.872943:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979569408:0@lo:400:kworker.0 00000100:00100000:2.0:1787383235.891059:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979568768:0@lo:400:kworker.0 00000100:00100000:3.0:1787383236.362762:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383236.362787:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979569536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383236.362889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383236.362974:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569536 00000100:00100000:3.0:1787383236.362981:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569536 00000100:00100000:3.0:1787383236.363023:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383236.363031:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979569536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383236.363064:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383236.364567:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979569536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1526us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383236.364580:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787383236.365470:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b1c00 x1874206979569536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383236.365496:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979569536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383236.436198:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383236.875197:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383236.875220:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979569664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383236.875309:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383236.875371:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569664 00000100:00100000:2.0:1787383236.875378:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569664 00000100:00100000:2.0:1787383236.875435:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787383236.875445:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979569664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383236.875478:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383236.875520:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979569664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383236.875527:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787383236.875570:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c853800 x1874206979569664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383236.875588:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979569664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383237.455119:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383238.483897:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383239.158642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383239.159931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383239.159969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383239.160408:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759424 00000100:00100000:0.0:1787383239.160417:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759424 00000100:00100000:0.0:1787383239.160468:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:0.0:1787383239.160477:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962759424:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383239.160547:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962759424:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383239.160554:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:1.0:1787383239.166089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383239.166120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383239.166167:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759808 00000100:00100000:1.0:1787383239.166176:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759808 00000100:00100000:1.0:1787383239.166240:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759936 00000100:00100000:1.0:1787383239.166244:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759936 00000100:00100000:1.0:1787383239.166267:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1787383239.166275:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2347:x1874206962759808:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:1.0:1787383239.166307:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ceb51 00000100:00080000:1.0:1787383239.166315:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb22000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383239.166538:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787383239.167061:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+2:2347:x1874206962759808:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 784us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383239.167070:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1787383239.167089:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1787383239.167096:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2347:x1874206962759936:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:1.0:1787383239.167111:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ceb58 00000100:00080000:1.0:1787383239.167119:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb22800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383239.167155:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787383239.167497:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+2:2347:x1874206962759936:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 399us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383239.167504:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:1.0:1787383239.167530:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383239.167534:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787383239.167545:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383239.168668:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383239.171026:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759552 00000100:00100000:2.0:1787383239.171043:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759552 00000100:00100000:2.0:1787383239.171156:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962759680 00000100:00100000:2.0:1787383239.171161:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962759680 00000100:00100000:2.0:1787383239.171192:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1787383239.171211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962759552:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383239.171304:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962759552:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 102us (12671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383239.171311:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1787383239.171336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1787383239.171343:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962759680:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383239.171370:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962759680:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (11399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383239.171393:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00080000:1.0:1787383239.171442:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383239.498857:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383240.522109:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383240.973833:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979570176:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.973924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.973973:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383240.973979:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979569792:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.974034:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979570304:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.974083:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979570048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.974126:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787383240.974131:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979569920:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.974168:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979570432:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383240.974226:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569792 00000100:00100000:2.0:1787383240.974233:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569792 00000100:00100000:2.0:1787383240.974275:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787383240.974283:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979569792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974332:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979569792:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383240.974340:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787383240.974374:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570304 00000100:00100000:2.0:1787383240.974378:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570304 00000100:00100000:2.0:1787383240.974434:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570048 00000100:00100000:2.0:1787383240.974437:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570048 00000100:00100000:2.0:1787383240.974449:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979569920 00000100:00100000:2.0:1787383240.974452:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979569920 00000100:00100000:2.0:1787383240.974462:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383240.974467:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979570304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974513:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979570304:12345-0@lo:400:kworker.0 Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383240.974519:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383240.974530:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383240.974536:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979570048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974566:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979570048:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383240.974572:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383240.974583:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383240.974589:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979569920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974614:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979569920:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383240.974619:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383240.974667:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979569920:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979570048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974784:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979569792:0@lo:400:kworker.0 00000100:00100000:2.0:1787383240.974794:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979570304:0@lo:400:kworker.0 00000100:00100000:1.0:1787383240.974936:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570176 00000100:00100000:1.0:1787383240.974941:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570176 00000100:00100000:1.0:1787383240.974969:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570432 00000100:00100000:1.0:1787383240.974972:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570432 00000100:00100000:1.0:1787383240.974986:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383240.974992:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979570176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383240.975031:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979570176:12345-0@lo:400:kworker.0 Request processed in 39us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383240.975037:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383240.975050:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383240.975056:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979570432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383240.975096:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979570432:12345-0@lo:400:kworker.0 Request processed in 41us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383240.975103:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787383240.975122:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383240.975126:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383240.975129:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787383240.975151:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc05153b80 x1874206979570432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383240.975162:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979570432:0@lo:400:kworker.0 00010000:00080000:1.0:1787383240.975196:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c851180 x1874206979570176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383240.975205:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979570176:0@lo:400:kworker.0 00000001:00100000:0.0:1787383241.051797:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000020:00000080:0.0:1787383241.051808:0:6624:0:(genops.c:906:class_export_put()) final put ffff9ffc3cb23800/7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000020:00000080:1.0:1787383241.051896:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3cb23800/7f7d4d88-92fa-41ed-9228-fa6a1116f23d for lustre-OST0000 00000020:00000080:1.0:1787383241.051947:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3cb22000 for lustre-OST0000 00000100:00100000:1.0:1787383241.483275:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979570560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383241.483348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383241.483654:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570560 00000100:00100000:2.0:1787383241.483662:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570560 00000100:00100000:2.0:1787383241.483748:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383241.483758:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979570560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383241.483792:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383241.483841:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979570560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383241.483848:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787383241.484298:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b0700 x1874206979570560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383241.484318:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979570560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383241.546934:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383241.608249:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000020:00000080:2.0:1787383241.608262:0:7504:0:(genops.c:906:class_export_put()) final put ffff9ffc3cb20000/7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000020:00000080:1.0:1787383241.608383:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3cb20000/7f7d4d88-92fa-41ed-9228-fa6a1116f23d for lustre-OST0001 00000020:00000080:1.0:1787383241.608447:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3cb22800 for lustre-OST0001 00000100:00100000:0.0:1787383241.994220:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383241.994247:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979570688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383241.994320:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383241.994501:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570688 00000100:00100000:2.0:1787383241.994511:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570688 00000100:00100000:2.0:1787383241.994566:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383241.994575:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979570688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383241.994613:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383241.994667:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979570688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383241.994674:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787383241.994767:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d711c00 x1874206979570688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383241.994786:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979570688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787383242.571590:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383243.264326:0:10881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787383243.594147:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383244.271486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383244.271530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383244.271629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383244.272236:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760064 00000100:00100000:2.0:1787383244.272247:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760064 00000100:00100000:2.0:1787383244.272300:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:2.0:1787383244.272311:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962760064:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383244.272386:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962760064:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383244.273792:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:0.0:1787383244.282048:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760320 00000100:00100000:0.0:1787383244.282065:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760320 00000100:00100000:0.0:1787383244.282147:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760192 00000100:00100000:0.0:1787383244.282175:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760192 00000100:00100000:0.0:1787383244.282215:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1787383244.282226:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962760320:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383244.282310:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962760320:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 86us (10778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383244.282318:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1787383244.282336:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:0.0:1787383244.282343:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962760192:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383244.282371:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962760192:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (10742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383244.282377:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00080000:3.0:1787383244.282431:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383244.618120:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383245.652920:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383246.091781:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979571200:0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.091855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383246.091943:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787383246.091949:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979570816:0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.091977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383246.091998:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cfff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979571328:0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.092024:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383246.092056:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571328 00000100:00100000:0.0:1787383246.092063:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571328 00000100:00100000:0.0:1787383246.092118:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383246.092127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979571328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.092194:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979571328:12345-0@lo:400:kworker.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383246.092202:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787383246.092243:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383246.092280:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cfff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979571328:0@lo:400:kworker.0 00000100:00100000:2.0:1787383246.092512:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570816 00000100:00100000:2.0:1787383246.092516:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570816 00000100:00100000:2.0:1787383246.092550:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787383246.092557:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979570816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383246.092600:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979570816:12345-0@lo:400:kworker.0 Request processed in 44us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383246.092606:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787383246.092642:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979570816:0@lo:400:kworker.0 00000100:00100000:1.0:1787383246.093355:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979570944:0@lo:400:kworker.0 00000100:00100000:1.0:1787383246.093399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383246.093462:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979571456:0@lo:400:kworker.0 00000100:00100000:1.0:1787383246.093488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383246.093508:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383246.093514:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979571072:0@lo:400:kworker.0 00000100:00100000:1.0:1787383246.093533:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383246.093604:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571200 00000100:00100000:3.0:1787383246.093609:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571200 00000100:00100000:3.0:1787383246.093657:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571456 00000100:00100000:3.0:1787383246.093661:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571456 00000100:00100000:3.0:1787383246.093674:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383246.093685:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979571200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383246.093746:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979571200:12345-0@lo:400:kworker.0 Request processed in 64us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383246.093753:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383246.093766:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383246.093772:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979571456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383246.093799:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979571456:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383246.093804:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787383246.093857:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383246.093862:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383246.093907:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3cffdc00 x1874206979571200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383246.093919:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979571200:0@lo:400:kworker.0 00010000:00080000:1.0:1787383246.095863:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3cffd180 x1874206979571456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383246.095901:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979571456:0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.098627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979570944 00000100:00100000:0.0:1787383246.098643:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979570944 00000100:00100000:0.0:1787383246.098748:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571072 00000100:00100000:0.0:1787383246.098752:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571072 00000100:00100000:0.0:1787383246.098789:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383246.098798:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979570944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.098904:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979570944:12345-0@lo:400:kworker.0 Request processed in 106us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383246.098912:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383246.098929:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383246.098936:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979571072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.098964:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979571072:12345-0@lo:400:kworker.0 Request processed in 29us (5429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383246.098970:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383246.099008:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979571072:0@lo:400:kworker.0 00000100:00100000:0.0:1787383246.099021:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979570944:0@lo:400:kworker.0 00000100:00080000:2.0:1787383246.099233:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383246.606974:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383246.607043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383246.608930:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571584 00000100:00100000:2.0:1787383246.608943:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571584 00000100:00100000:2.0:1787383246.608993:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383246.609021:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979571584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383246.609055:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383246.609121:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979571584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383246.609129:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787383246.609317:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c951f80 x1874206979571584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383246.609338:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979571584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383246.673343:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787383246.914930:0:11029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffccc5d90b0 00000020:00000080:0.0:1787383246.914946:0:11029:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787383246.914952:0:11029:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787383246.915015:0:11029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccc5db340 20000000:00000080:1.0:1787383246.915025:0:11029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc05f18800 uarg=0000000000000000 20000000:01000000:1.0:1787383246.915064:0:11029:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787383246.915069:0:11029:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787383246.915076:0:11029:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787383246.915759:0:11030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787383246.916033:0:11029:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787383246.921061:0:11029:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787383246.921095:0:11029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921118:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921127:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921143:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921295:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921302:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921309:0:11029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921351:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921365:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 12 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.921381:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571712:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383246.921511:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921519:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 18 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.921530:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571840:0@lo:104: 00000100:00100000:1.0:1787383246.921571:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383246.921618:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921626:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 18 pid: 5796 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.921641:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571968:0@lo:104: 00000100:00100000:1.0:1787383246.921662:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383246.921692:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921710:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 18 pid: 5797 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.921719:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979572096:0@lo:104: 00000100:00100000:1.0:1787383246.921739:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383246.921755:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.921762:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 12 pid: 5796 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.921770:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979572224:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383246.921789:0:11029:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05f1f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383246.922004:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571840 00000100:00100000:3.0:1787383246.922013:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571840 00000100:00100000:3.0:1787383246.922091:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979571968 00000100:00100000:3.0:1787383246.922095:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979571968 00000100:00100000:3.0:1787383246.922108:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572096 00000100:00100000:3.0:1787383246.922110:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572096 00000100:00100000:3.0:1787383246.922123:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383246.922143:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:11029:x1874206979571840:12345-0@lo:104: 00010000:00010000:3.0:1787383246.922164:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.922226:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383246.922233:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:11029:x1874206979571840:12345-0@lo:104: Request processed in 102us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383246.922240:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787383246.922253:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787383246.922257:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787383246.922260:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922275:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383246.922279:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922288:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383246.922295:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.922301:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:11029:x1874206979571968:12345-0@lo:104: 10000000:01000000:2.0:1787383246.922301:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383246.922309:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922330:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922336:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383246.922347:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383246.922352:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:11029:x1874206979571968:12345-0@lo:104: Request processed in 90us (689us total) trans 0 rc 0/0 00010000:00010000:2.0:1787383246.922352:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.922359:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787383246.922359:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5ceb27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb2e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.922370:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787383246.922372:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383246.922375:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.922376:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:11029:x1874206979572096:12345-0@lo:104: 00010000:00010000:2.0:1787383246.922381:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc1cf6c20) 00010000:00010000:3.0:1787383246.922384:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383246.922384:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922401:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.922408:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1787383246.922408:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.922412:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:11029:x1874206979572096:12345-0@lo:104: Request processed in 38us (673us total) trans 0 rc 0/0 10000000:01000000:2.0:1787383246.922413:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787383246.922418:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787383246.922426:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922431:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383246.922434:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383246.922437:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922444:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99a00/0x42020b050d5ceb19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922453:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383246.922455:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383246.922456:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383246.922474:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979572352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383246.922504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383246.922569:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383246.922575:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.922582:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383246.922585:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.922592:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383246.922598:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383246.922615:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383246.922633:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383246.922633:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787383246.922639:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383246.922639:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979572480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383246.922652:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.922659:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17046c00/0x42020b050d5ceb0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb12 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383246.922660:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383246.922673:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383246.922674:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383246.922676:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383246.922679:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383246.922681:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383246.922683:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383246.922691:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979572608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383246.922711:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383246.922746:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572352 00000100:00100000:0.0:1787383246.922747:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572480 00000100:00100000:2.0:1787383246.922751:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572352 00000100:00100000:0.0:1787383246.922751:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572480 00010000:00010000:2.0:1787383246.922769:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 20 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383246.922769:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 20 pid: 5796 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383246.922795:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572608 00000100:00100000:0.0:1787383246.922798:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572608 00010000:00010000:0.0:1787383246.922816:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 21 pid: 5797 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383246.922847:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383246.922854:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+21:3314:x1874206979572480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383246.922865:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383246.922885:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 21 pid: 5796 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922894:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 21 pid: 5796 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.922909:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383246.922934:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+21:3314:x1874206979572480:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383246.922939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383246.922952:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383246.922958:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+20:3314:x1874206979572352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383246.923109:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571840:0@lo:104: 00010000:00010000:1.0:1787383246.923120:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5ceb20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb19 expref: 20 pid: 5796 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.923143:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571968:0@lo:104: 00000100:00100000:1.0:1787383246.923154:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979572096:0@lo:104: 00010000:00010000:2.0:1787383246.923316:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383246.923323:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 19 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383246.923373:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383246.923383:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3313:x1874206979572608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383246.923391:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383246.923395:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 19 pid: 5797 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.923403:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 19 pid: 5797 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.923413:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb0b expref: 19 pid: 5797 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.923421:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383246.923457:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3313:x1874206979572608:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383246.923463:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787383246.924431:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.924446:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb27 expref: 17 pid: 5798 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.924580:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383246.924621:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3314:x1874206979572352:12345-0@lo:103:ldlm_bl.0 Request processed in 1663us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383246.924629:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383246.924777:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979572608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383246.924811:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979572480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383246.924819:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979572352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383246.925815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383246.925860:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760448 00000100:00100000:2.0:1787383246.925884:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760448 00010000:00010000:2.0:1787383246.925917:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 13 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383246.925919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383246.925942:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760576 00000100:00100000:2.0:1787383246.925945:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760576 00010000:00010000:2.0:1787383246.925956:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 14 pid: 5796 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383246.925983:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1787383246.925991:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+14:2348:x1874206962760448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383246.926003:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383246.926008:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.926018:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383246.926050:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383246.926090:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+14:2348:x1874206962760448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 100us (279us total) trans 0 rc 0/0 00010000:00010000:1.0:1787383246.926166:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046a00/0x42020b050d5ceb43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b084 expref: 14 pid: 5798 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383246.926189:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979571712:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383246.926202:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1874206979572224:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383246.926245:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1787383246.926260:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962760576:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383246.926268:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383246.926273:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 13 pid: 5796 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926282:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 13 pid: 5796 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926291:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046600/0x42020b050d5ceb04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b04c expref: 13 pid: 5796 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926302:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926309:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926323:0:8310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926329:0:8310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926336:0:8310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926342:0:8310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926352:0:8310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383246.926357:0:8310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926367:0:8310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926375:0:8310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383246.926384:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383246.926402:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:2348:x1874206962760576:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 150us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383246.926408:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00010000:00010000:1.0:1787383246.926569:0:11029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.926579:0:11029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.926584:0:11029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383246.926590:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5ceb5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383246.927584:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1787383247.114277:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979572736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383247.114365:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383247.114581:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572736 00000100:00100000:2.0:1787383247.114588:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572736 00000100:00100000:2.0:1787383247.114642:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787383247.114653:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979572736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383247.114698:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383247.114794:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979572736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383247.114802:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787383247.116548:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d713480 x1874206979572736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383247.116574:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979572736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787383247.690060:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383248.240048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383248.240178:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760704 00000100:00100000:0.0:1787383248.240192:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760704 00000100:00100000:0.0:1787383248.240260:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:0.0:1787383248.240273:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:5563:x1874206962760704:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383248.240296:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383248.240323:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0ae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383248.240357:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383248.240371:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383248.240381:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047000, rc 0) 00000100:00100000:0.0:1787383248.240453:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962760704:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 182us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383248.240461:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1787383248.244857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383248.249073:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760832 00000100:00100000:0.0:1787383248.249091:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760832 00000100:00100000:0.0:1787383248.249220:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:0.0:1787383248.249232:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962760832:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383248.249625:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962760832:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 393us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383248.249633:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:1.0:1787383248.253945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383248.254936:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962760960 00000100:00100000:2.0:1787383248.254952:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962760960 00000100:00100000:2.0:1787383248.255014:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1787383248.255025:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962760960:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.255328:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962760960:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 304us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383248.255338:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:0.0:1787383248.267993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383248.268350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761088 00000100:00100000:2.0:1787383248.268364:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761088 00000100:00100000:2.0:1787383248.268426:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1787383248.268437:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962761088:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383248.268468:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383248.268491:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0b5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.268527:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.268543:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.268554:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514e00, rc 0) 00000100:00100000:2.0:1787383248.268629:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962761088:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 193us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383248.268637:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:3.0:1787383248.275115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383248.275175:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761216 00000100:00100000:3.0:1787383248.275188:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761216 00000100:00100000:3.0:1787383248.275272:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:3.0:1787383248.275286:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962761216:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.275675:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962761216:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 390us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.275686:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:3.0:1787383248.281519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383248.285642:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761344 00000100:00100000:0.0:1787383248.285663:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761344 00000100:00100000:0.0:1787383248.285894:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:0.0:1787383248.285907:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962761344:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383248.286191:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962761344:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 287us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383248.286200:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 234 00010000:00010000:3.0:1787383248.714089:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787383248.781167:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383248.781180:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3ff86800 from 7 10000000:01000000:2.0:1787383248.781187:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383248.781255:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.781270:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.781793:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383248.781835:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979572864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.782211:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383248.782369:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.787043:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572864 00000100:00100000:3.0:1787383248.787070:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572864 00000100:00100000:3.0:1787383248.787175:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787383248.787190:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979572864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.787215:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383248.787239:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb74 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.787290:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.787305:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.787316:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99000, rc 0) 00000100:00100000:3.0:1787383248.787428:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979572864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (5217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.787436:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787383248.787520:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979572864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.787545:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.787556:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383248.787660:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979572992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.787703:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.787753:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.787771:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979572992 00000100:00100000:3.0:1787383248.787776:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979572992 00000100:00100000:3.0:1787383248.787816:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787383248.787823:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979572992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.790090:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979572992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2253us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.790110:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787383248.790217:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979572992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.791399:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.791489:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.791546:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383248.791627:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573120 00000100:00100000:2.0:1787383248.791636:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573120 00000100:00100000:2.0:1787383248.791701:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787383248.791719:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979573120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.792122:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979573120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 396us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383248.792131:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787383248.792257:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383248.794226:0:11108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787383248.795220:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787383248.795251:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383248.795266:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.795784:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383248.795798:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383248.795801:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3dc13000 from 7 10000000:01000000:2.0:1787383248.795805:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383248.795859:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.796029:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.796043:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383248.796075:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.796178:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383248.796228:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.797932:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573248 00000100:00100000:3.0:1787383248.797948:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573248 00000100:00100000:3.0:1787383248.798016:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787383248.798027:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979573248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.798047:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383248.798067:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb82 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.798098:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.798122:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.798134:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99200, rc 0) 00000100:00100000:3.0:1787383248.798223:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.798239:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787383248.798323:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.798344:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.798355:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383248.798436:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.798468:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.798496:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.798508:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573376 00000100:00100000:3.0:1787383248.798512:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573376 00000100:00100000:3.0:1787383248.798531:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787383248.798537:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.798852:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.798860:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787383248.798914:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.798944:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.798985:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.798996:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.799006:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573504 00000100:00100000:3.0:1787383248.799010:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573504 00000100:00100000:3.0:1787383248.799027:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787383248.799039:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.799205:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.799212:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787383248.799250:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383248.800695:0:11109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787383248.801217:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787383248.801582:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383248.801600:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.801627:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383248.801996:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383248.802001:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc2750b800 from 7 10000000:01000000:2.0:1787383248.802004:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383248.802056:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.802064:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383248.802074:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383248.802101:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.802207:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383248.802262:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.802435:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573632 00000100:00100000:3.0:1787383248.802444:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573632 00000100:00100000:3.0:1787383248.802521:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787383248.802533:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979573632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.802553:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383248.802572:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5ceb90 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.802604:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.802616:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.802628:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98c00, rc 0) 00000100:00100000:3.0:1787383248.802801:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979573632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.802813:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787383248.803011:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d713480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383248.803031:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383248.803041:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383248.803133:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.803166:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.803234:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc04cd5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383248.803268:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573760 00000100:00100000:2.0:1787383248.803273:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573760 00000100:00100000:2.0:1787383248.803411:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787383248.803419:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979573760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383248.803851:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979573760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 432us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383248.803860:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787383248.805881:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.806042:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.806165:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383248.806229:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc04cd5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383248.806425:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979573888 00000100:00100000:3.0:1787383248.806433:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979573888 00000100:00100000:3.0:1787383248.806594:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787383248.806608:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979573888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383248.808552:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979573888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1938us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383248.808568:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787383248.808859:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979573888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383248.811592:0:11110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787383248.812883:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787383248.812923:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383248.813387:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383248.813403:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383249.391525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383249.391572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383249.391607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383249.391636:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761600 00000100:00100000:0.0:1787383249.391652:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761600 00000100:00100000:0.0:1787383249.391706:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761728 00000100:00100000:0.0:1787383249.391709:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761728 00000100:00100000:0.0:1787383249.391731:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1787383249.391741:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962761600:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383249.391817:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962761600:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383249.391825:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1787383249.391841:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1787383249.391847:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962761728:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383249.392047:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962761728:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 198us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383249.392054:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00080000:2.0:1787383249.392133:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383249.392229:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761472 00000100:00100000:3.0:1787383249.392234:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761472 00000100:00100000:3.0:1787383249.392272:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 244 00000100:00100000:3.0:1787383249.392279:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962761472:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383249.392305:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962761472:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383249.392312:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 244 00010000:00010000:3.0:1787383249.738061:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383250.766212:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383250.920031:0:11227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787383251.210849:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979574016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.210947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383251.210991:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979574528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383251.211066:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383251.211073:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979574144:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211107:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383251.211126:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979574656:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211151:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383251.211183:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574016 00000100:00100000:2.0:1787383251.211190:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574016 00000100:00100000:3.0:1787383251.211200:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574528 00000100:00100000:3.0:1787383251.211203:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574528 00000100:00100000:2.0:1787383251.211232:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787383251.211233:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574144 00000100:00100000:3.0:1787383251.211235:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574144 00000100:00100000:2.0:1787383251.211240:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979574016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383251.211252:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787383251.211258:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979574528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383251.211289:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979574528:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383251.211289:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979574016:12345-0@lo:400:kworker.0 Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383251.211297:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787383251.211297:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787383251.211310:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787383251.211316:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979574144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211330:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574656 00000100:00100000:2.0:1787383251.211334:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574656 00000100:00100000:3.0:1787383251.211339:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979574144:12345-0@lo:400:kworker.0 Request processed in 24us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383251.211345:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787383251.211360:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383251.211367:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979574656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211397:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979574656:12345-0@lo:400:kworker.0 Request processed in 31us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383251.211403:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787383251.211418:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383251.211423:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383251.211786:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979574144:0@lo:400:kworker.0 00010000:00080000:2.0:1787383251.211800:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c827800 x1874206979574656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383251.211810:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979574656:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979574016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383251.211838:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979574528:0@lo:400:kworker.0 00000100:00100000:0.0:1787383251.211985:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979574400:0@lo:400:kworker.0 00000100:00100000:0.0:1787383251.212016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383251.212035:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383251.212041:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979574272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383251.212058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383251.212077:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574272 00000100:00100000:0.0:1787383251.212081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574272 00000100:00100000:0.0:1787383251.212121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787383251.212127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979574272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383251.212157:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979574272:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383251.212163:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787383251.212175:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383251.212195:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979574272:0@lo:400:kworker.0 00000100:00100000:1.0:1787383251.212850:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574400 00000100:00100000:1.0:1787383251.212856:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574400 00000100:00100000:1.0:1787383251.212911:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787383251.212918:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979574400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383251.212960:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979574400:12345-0@lo:400:kworker.0 Request processed in 43us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383251.212966:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787383251.212979:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787383251.212997:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c826d80 x1874206979574400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383251.213022:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979574400:0@lo:400:kworker.0 00000100:00100000:1.0:1787383251.722454:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383251.722477:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979574784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383251.722547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383251.722914:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574784 00000100:00100000:2.0:1787383251.722930:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574784 00000100:00100000:2.0:1787383251.723008:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383251.723021:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979574784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383251.723069:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383251.723171:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979574784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383251.723182:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787383251.723220:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d716680 x1874206979574784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383251.724370:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979574784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383251.787771:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383252.235833:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383252.235861:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979574912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383252.235963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383252.236073:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979574912 00000100:00100000:2.0:1787383252.236091:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979574912 00000100:00100000:2.0:1787383252.236161:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383252.236170:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979574912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383252.236206:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383252.236260:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979574912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383252.236267:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787383252.236318:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc05150000 x1874206979574912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383252.236604:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979574912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383252.811041:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383253.833950:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383254.430546:0:11328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:20:53 (1787383253) === 00000100:00100000:3.0:1787383254.522174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.522209:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.522237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.522263:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962762112 00000100:00100000:3.0:1787383254.522271:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962762112 00000100:00100000:3.0:1787383254.522330:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761984 00000100:00100000:3.0:1787383254.522334:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761984 00000100:00100000:3.0:1787383254.522361:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1787383254.522371:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962762112:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383254.522446:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962762112:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383254.522453:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1787383254.522469:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1787383254.522475:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962761984:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383254.522499:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962761984:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383254.522505:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00080000:3.0:1787383254.522522:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383254.522912:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962761856 00000100:00100000:2.0:1787383254.522918:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962761856 00000100:00100000:2.0:1787383254.522953:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 246 00000100:00100000:2.0:1787383254.522961:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962761856:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383254.523007:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962761856:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.523014:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 246 00000100:00100000:3.0:1787383254.818563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.818643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383254.818823:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962762240 00000100:00100000:2.0:1787383254.818837:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962762240 00000100:00100000:2.0:1787383254.819003:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1787383254.819016:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962762240:12345-192.168.202.19@tcp:41:mkdir.0 00000004:00000024:2.0:1787383254.819117:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787383254.819240:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962762240:12345-192.168.202.19@tcp:41:mkdir.0 Request processed in 225us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.819249:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1787383254.820446:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962762368 00000100:00100000:1.0:1787383254.820460:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962762368 00000100:00100000:1.0:1787383254.820530:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383254.820541:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9651:x1874206962762368:12345-192.168.202.19@tcp:700:mkdir.0 00000100:00100000:1.0:1787383254.820622:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9651:x1874206962762368:12345-192.168.202.19@tcp:700:mkdir.0 Request processed in 83us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.820631:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1787383254.834091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383254.834242:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962762624 00000100:00100000:0.0:1787383254.834258:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962762624 00000100:00100000:0.0:1787383254.834352:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1787383254.834366:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9651:x1874206962762624:12345-192.168.202.19@tcp:36:mkdir.0 00010000:00010000:0.0:1787383254.834454:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383254.834496:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01410800/0x42020b050d5cea7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b037 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.834527:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc06943d00) 00010000:00010000:0.0:1787383254.834541:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383254.835045:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.835074:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.835089:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.841931:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.841958:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.841973:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383254.850450:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787383254.850472:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850483:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850491:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850496:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383254.850501:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850508:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850524:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc0a060300) 00010000:00010000:0.0:1787383254.850528:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383254.850532:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.850538:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceb9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383254.850561:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000543f9666 reply state 0000000047740244 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383254.850571:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383254.855250:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9651:x1874206962762624:12345-192.168.202.19@tcp:36:mkdir.0 Request processed in 20876us (21162us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787383254.855280:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00010000:00010000:1.0:1787383254.858759:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858778:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858784:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858788:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383254.858792:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858818:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858838:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffc0a060800) 00010000:00010000:1.0:1787383254.858841:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383254.858847:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383254.858854:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ceba5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.858944:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383254.873364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383254.873808:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962762752 00000100:00100000:2.0:1787383254.873832:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962762752 00000100:00100000:2.0:1787383254.874122:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1787383254.874135:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9653:x1874206962762752:12345-192.168.202.19@tcp:101:chmod.0 00010000:00010000:2.0:1787383254.874165:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383254.874312:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cebac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0bc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874420:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874437:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874451:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383254.874554:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787383254.874559:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383254.874609:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874653:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cebac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0bc expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874676:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0bc expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.874686:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5300) 00010000:00010000:2.0:1787383254.874690:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383254.874694:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:2.0:1787383254.876282:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9653:x1874206962762752:12345-192.168.202.19@tcp:101:chmod.0 Request processed in 2139us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.876295:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1787383254.879721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.880024:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763008 00000100:00100000:3.0:1787383254.880039:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763008 00000100:00100000:3.0:1787383254.880156:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1787383254.880170:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9653:x1874206962763008:12345-192.168.202.19@tcp:36:chmod.0 00010000:00010000:3.0:1787383254.880387:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383254.880426:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cebb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0bc expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.880461:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5300) 00010000:00010000:3.0:1787383254.880477:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383254.880516:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.880532:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.880543:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383254.883036:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8e41964 reply state 00000000723b9d68 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383254.883072:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787383254.883124:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787383254.883978:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:9653:x1874206962763008:12345-192.168.202.19@tcp:36:chmod.0 Request processed in 3803us (4263us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787383254.883992:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00010000:00010000:2.0:1787383254.917408:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917435:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917444:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917450:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383254.917456:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917483:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917507:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fec00) 00010000:00010000:2.0:1787383254.917510:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383254.917515:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383254.917522:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cebba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383254.942477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.947109:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763136 00000100:00100000:3.0:1787383254.947128:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763136 00000100:00100000:3.0:1787383254.947217:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383254.947227:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9654:x1874206962763136:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:3.0:1787383254.947280:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383254.947309:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0c3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947400:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947418:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947432:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383254.947514:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787383254.947519:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383254.947573:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947606:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0c3 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947775:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0c3 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.947788:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383254.947792:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383254.947797:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99600, rc 0) 00000100:00100000:3.0:1787383254.949843:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:9654:x1874206962763136:12345-192.168.202.19@tcp:101:chown.0 Request processed in 2605us (7372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383254.949855:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383254.958065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383254.962959:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763264 00000100:00100000:0.0:1787383254.962985:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763264 00000100:00100000:0.0:1787383254.963102:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1787383254.963118:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:9654:x1874206962763264:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:0.0:1787383254.963150:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383254.963184:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0ca expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963276:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963292:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963306:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963323:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963330:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963336:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963477:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963504:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963511:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383254.963563:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787383254.963567:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383254.963599:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963615:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963622:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963641:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963648:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383254.963653:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963661:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963677:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:0.0:1787383254.963681:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383254.963696:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963715:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cebd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963732:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963738:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963746:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963750:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383254.963754:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963760:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963767:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffc0a060300) 00010000:00010000:0.0:1787383254.963770:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383254.963772:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963778:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cebdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963818:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ca expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963834:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ca expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383254.963849:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060600) 00010000:00010000:0.0:1787383254.963851:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383254.963855:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047c00, rc 0) 00000100:00100000:0.0:1787383254.964321:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:9654:x1874206962763264:12345-192.168.202.19@tcp:101:chown.0 Request processed in 1203us (6278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.964331:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1787383254.974321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383254.974443:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763520 00000100:00100000:3.0:1787383254.974457:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763520 00000100:00100000:3.0:1787383254.974540:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383254.974554:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:9654:x1874206962763520:12345-192.168.202.19@tcp:36:chown.0 00010000:00010000:3.0:1787383254.974633:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383254.974668:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cebe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ca expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.974702:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060600) 00010000:00010000:3.0:1787383254.974717:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383254.974757:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.974773:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383254.974785:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383255.036916:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787383255.039355:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787383255.039489:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006612fec7 reply state 000000002aae380c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383255.039507:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787383255.041012:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787383255.041295:0:5804:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787383255.041325:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9654:x1874206962763520:12345-192.168.202.19@tcp:36:chown.0 Request processed in 66767us (67014us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787383255.041337:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:1.0:1787383255.041451:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041465:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041473:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041480:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383255.041485:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041493:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041514:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383255.041518:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787383255.041537:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.041543:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cebeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383255.063966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.066108:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763648 00000100:00100000:3.0:1787383255.066131:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763648 00000100:00100000:2.0:1787383255.066423:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1787383255.066439:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9656:x1874206962763648:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:2.0:1787383255.066477:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383255.066507:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cebf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0d1 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383255.071141:0:8068:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4548us 00010000:00010000:0.0:1787383255.088890:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.088923:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.088938:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.088957:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.088964:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.088992:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.089526:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.089538:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.089545:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383255.089833:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787383255.089838:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383255.090935:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.090963:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.090971:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.090979:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.090987:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383255.090993:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091002:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091031:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:0.0:1787383255.091034:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383255.091039:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091045:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cebf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091073:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091080:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091086:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091092:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383255.091095:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091102:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091110:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffc0a060300) 00010000:00010000:0.0:1787383255.091112:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383255.091116:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091122:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091190:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cebf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d1 expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091209:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d1 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.091217:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:0.0:1787383255.091219:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787383255.091222:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047400, rc 0) 00000100:00100000:0.0:1787383255.091315:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9656:x1874206962763648:12345-192.168.202.19@tcp:101:touch.500 Request processed in 24879us (27365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383255.091326:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1787383255.096183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.096385:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962763904 00000100:00100000:3.0:1787383255.096400:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962763904 00000100:00100000:3.0:1787383255.096487:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1787383255.096500:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9656:x1874206962763904:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:3.0:1787383255.096531:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383255.096561:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0d8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.097912:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.097935:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.097950:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.099432:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.099454:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.099468:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383255.100618:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787383255.101150:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cec23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101166:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cec23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101176:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cec23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101211:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101231:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101237:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101244:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383255.101248:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101256:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101268:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:3.0:1787383255.101270:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383255.101274:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101279:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383255.101291:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040f99379 reply state 00000000d2b04c72 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383255.101299:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787383255.101332:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d8 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101462:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cec23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d8 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.101479:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc094fef00) 00010000:00010000:3.0:1787383255.101482:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383255.101484:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99a00, rc 0) 00000100:00100000:3.0:1787383255.101556:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:9656:x1874206962763904:12345-192.168.202.19@tcp:101:touch.500 Request processed in 5060us (5389us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787383255.101566:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00010000:00010000:1.0:1787383255.103932:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.103954:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.103962:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.103969:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383255.103974:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.103982:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.104000:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd2d2e79c (ffff9ffc094fe800) 00010000:00010000:1.0:1787383255.104004:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383255.104010:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.104017:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5cec1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383255.109449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383255.112005:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764160 00000100:00100000:0.0:1787383255.112024:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764160 00000100:00100000:0.0:1787383255.112123:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1787383255.112134:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:9656:x1874206962764160:12345-192.168.202.19@tcp:36:touch.500 00010000:00010000:0.0:1787383255.112213:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383255.112247:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cec23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d8 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.112703:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc094fef00) 00010000:00010000:0.0:1787383255.112720:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383255.112777:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.112793:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.112820:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383255.113183:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1f7d3f6 reply state 00000000a6567d25 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383255.113197:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383255.113342:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:9656:x1874206962764160:12345-192.168.202.19@tcp:36:touch.500 Request processed in 1206us (3910us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787383255.113351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00010000:00010000:3.0:1787383255.115280:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115300:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115309:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115316:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383255.115321:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115328:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115359:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc0a060300) 00010000:00010000:3.0:1787383255.115362:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383255.115367:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.115372:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cec31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383255.116165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383255.116232:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764288 00000100:00100000:0.0:1787383255.116249:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764288 00000100:00100000:0.0:1787383255.116324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1787383255.116336:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:9656:x1874206962764288:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:0.0:1787383255.116371:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383255.116400:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cec38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0df expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.116474:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cec38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0df expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.116491:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cec38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0df expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.116514:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc0a060d00) 00010000:00010000:0.0:1787383255.116518:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383255.116522:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383255.116626:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:9656:x1874206962764288:12345-192.168.202.19@tcp:101:touch.500 Request processed in 291us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383255.116634:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1787383255.119236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383255.123935:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764416 00000100:00100000:1.0:1787383255.123951:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764416 00000100:00100000:1.0:1787383255.124006:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383255.124029:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1874206962764416:12345-192.168.202.19@tcp:8:touch.500 00010000:00080000:1.0:1787383255.124079:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1787383255.124114:0:6600:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cec3f 00002000:00100000:1.0:1787383255.124124:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5843774-e16e-46d1-9ea7-9bdf9153dca9/ffff9ffc3ff83000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787383255.124149:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787383255.124398:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787383255.124434:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc170ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383255.124513:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962764416:12345-192.168.202.19@tcp:8:touch.500 Request processed in 481us (5285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383255.124521:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1787383255.128076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383255.129284:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764544 00000100:00100000:1.0:1787383255.129298:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764544 00000100:00100000:1.0:1787383255.129401:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1787383255.129412:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:0:x1874206962764544:12345-192.168.202.19@tcp:2:touch.500 00000100:00080000:3.0:1787383255.130036:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787383255.192907:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1787383255.192933:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000100:00100000:1.0:1787383255.193214:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:0:x1874206962764544:12345-192.168.202.19@tcp:2:touch.500 Request processed in 63795us (65154us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787383255.193229:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1787383255.196590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383255.196816:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764800 00000100:00100000:1.0:1787383255.196829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764800 00000100:00100000:1.0:1787383255.197035:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1787383255.197050:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:9656:x1874206962764800:12345-192.168.202.19@tcp:35:touch.500 00000100:00100000:1.0:1787383255.197779:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:9656:x1874206962764800:12345-192.168.202.19@tcp:35:touch.500 Request processed in 729us (1200us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787383255.197791:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1787383255.208030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.208216:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962764928 00000100:00100000:3.0:1787383255.208230:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962764928 00000100:00100000:3.0:1787383255.208325:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1787383255.208337:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:9657:x1874206962764928:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:3.0:1787383255.208371:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383255.208397:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0e6 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208484:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208500:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208513:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383255.208597:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787383255.208601:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383255.208720:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208756:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0e6 expref: 13 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208780:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0e6 expref: 12 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.208814:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:3.0:1787383255.208817:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383255.208822:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:2.0:1787383255.209210:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:9657:x1874206962764928:12345-192.168.202.19@tcp:101:rm.0 Request processed in 872us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383255.209220:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1787383255.212396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383255.212513:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962765184 00000100:00100000:2.0:1787383255.212527:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962765184 00000100:00100000:2.0:1787383255.212611:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1787383255.212623:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:9657:x1874206962765184:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:2.0:1787383255.212659:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383255.212685:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0ed expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383255.212836:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787383255.213100:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ed expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.213117:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:2.0:1787383255.213120:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383255.213126:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ed expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.213145:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383255.213225:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:9657:x1874206962765184:12345-192.168.202.19@tcp:101:rm.0 Request processed in 605us (844us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787383255.213231:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1787383255.218823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.218940:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962765312 00000100:00100000:3.0:1787383255.218953:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962765312 00000100:00100000:3.0:1787383255.219022:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1787383255.219034:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:9657:x1874206962765312:12345-192.168.202.19@tcp:37:rm.0 00000100:00100000:3.0:1787383255.225538:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:9657:x1874206962765312:12345-192.168.202.19@tcp:37:rm.0 Request processed in 6490us (6712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383255.225557:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1787383255.229555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.229752:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962765568 00000100:00100000:3.0:1787383255.229768:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962765568 00000100:00100000:3.0:1787383255.229847:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1787383255.229858:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:9657:x1874206962765568:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:3.0:1787383255.230249:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:9657:x1874206962765568:12345-192.168.202.19@tcp:35:rm.0 Request processed in 390us (707us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787383255.230258:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1787383255.234370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383255.234493:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962765824 00000100:00100000:2.0:1787383255.234507:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962765824 00000100:00100000:2.0:1787383255.234591:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1787383255.234603:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:9657:x1874206962765824:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:2.0:1787383255.234645:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383255.234673:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.234911:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cec69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.234929:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cec69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.234942:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cec69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383255.234957:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787383255.235184:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0f4 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.235206:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cec69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0f4 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.235215:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:2.0:1787383255.235218:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383255.235223:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:2.0:1787383255.235309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962765824:12345-192.168.202.19@tcp:101:rm.0 Request processed in 708us (953us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787383255.235319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1787383255.239063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.239164:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962765952 00000100:00100000:3.0:1787383255.239177:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962765952 00000100:00100000:3.0:1787383255.239246:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1787383255.239259:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962765952:12345-192.168.202.19@tcp:41:rm.0 00000004:00000024:3.0:1787383255.239358:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787383255.239460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962765952:12345-192.168.202.19@tcp:41:rm.0 Request processed in 203us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383255.239486:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1787383255.242612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383255.243216:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962766080 00000100:00100000:2.0:1787383255.243229:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962766080 00000100:00100000:2.0:1787383255.243461:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1787383255.243473:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962766080:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:2.0:1787383255.243518:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383255.243544:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b0fb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243641:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243659:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243672:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243692:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243700:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243707:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243861:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243891:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243898:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383255.243935:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787383255.243947:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383255.243971:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243984:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.243994:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244000:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244007:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244013:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383255.244017:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244025:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244039:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:2.0:1787383255.244043:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383255.244048:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244067:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cec7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244082:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244098:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244104:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244108:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383255.244111:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244116:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244124:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd2d2e79c (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383255.244126:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383255.244129:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244135:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cec85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244174:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cec77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0fb expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244187:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0fb expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.244195:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc0a060d00) 00010000:00010000:2.0:1787383255.244197:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383255.244206:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515000, rc 0) 00000100:00100000:2.0:1787383255.244304:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:9657:x1874206962766080:12345-192.168.202.19@tcp:101:rm.0 Request processed in 832us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383255.244312:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1787383255.247780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383255.248092:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962766336 00000100:00100000:3.0:1787383255.248106:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962766336 00000100:00100000:3.0:1787383255.248189:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383255.248202:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:9657:x1874206962766336:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:3.0:1787383255.248291:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787383255.248326:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cec8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0fb expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248353:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cec38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0df expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248365:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc0a060d00) 00010000:00010000:3.0:1787383255.248383:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cec4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0e6 expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248392:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:3.0:1787383255.248396:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383255.248422:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248436:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248446:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248484:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248492:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248498:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248733:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248742:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.248749:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383255.250239:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787383255.250256:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279464386604ns, next at 280464383543ns, rc = 0 00010000:00010000:3.0:1787383255.250337:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250353:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250364:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250374:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250393:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250399:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250481:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383255.250509:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250516:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250522:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250528:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383255.250533:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250540:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250553:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc094fe800) 00010000:00010000:3.0:1787383255.250565:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787383255.250569:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250576:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceca1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250596:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250608:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250614:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250619:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383255.250622:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250628:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250636:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:3.0:1787383255.250638:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383255.250641:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383255.250647:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cec93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383255.250658:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044517af4 reply state 000000000b20afb5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383255.250668:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383255.250780:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962766336:12345-192.168.202.19@tcp:36:rm.0 Request processed in 2576us (3013us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787383255.250791:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383255.254826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383255.255392:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962766592 00000100:00100000:1.0:1787383255.255410:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962766592 00000100:00100000:1.0:1787383255.255487:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1787383255.255501:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:9657:x1874206962766592:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:1.0:1787383255.256035:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:9657:x1874206962766592:12345-192.168.202.19@tcp:35:rm.0 Request processed in 534us (1221us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787383255.256045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:0.0:1787383255.257811:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383255.257830:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.257843:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383255.257849:0:11031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.257860:0:11031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.257898:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffc094fe800) 00010000:00010000:0.0:1787383255.257901:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787383255.257907:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.257913:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383255.257949:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383255.257951:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383255.257977:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383255.258644:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383255.258772:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962766848 00000100:00100000:1.0:1787383255.258784:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962766848 00000100:00100000:1.0:1787383255.258857:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1787383255.258894:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:9657:x1874206962766848:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:1.0:1787383255.258973:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787383255.259000:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cec69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0f4 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259023:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cec07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0d1 expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259034:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:1.0:1787383255.259064:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cebc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0c3 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259075:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:1.0:1787383255.259082:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383255.259114:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259146:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259157:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259170:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259177:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.259183:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259552:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259942:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259947:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259952:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383255.259955:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259960:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259969:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd2d2e79c (ffff9ffc094fef00) 00010000:00010000:2.0:1787383255.259971:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383255.259973:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.259978:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cec9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd2d2e79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.260152:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.260163:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.260172:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383255.261712:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787383255.261740:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261751:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261758:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261773:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383255.261778:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261786:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261803:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffc01425c00) 00010000:00010000:1.0:1787383255.261806:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787383255.261810:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261816:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cecbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261849:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261854:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.261861:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.262169:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383255.262177:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.262185:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.262206:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383255.262209:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383255.262212:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.262218:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cecaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383255.262232:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017e2419c reply state 000000001b8a1006 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383255.262242:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383255.262477:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:9657:x1874206962766848:12345-192.168.202.19@tcp:36:rm.0 Request processed in 3605us (3845us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787383255.262489:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00010000:00010000:1.0:1787383255.269854:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.269911:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.269920:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.269926:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383255.269931:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.269940:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.269985:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383255.269989:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383255.269994:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383255.270001:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cecb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383255.882033:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383256.335385:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979575040:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335558:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979575552:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787383256.335629:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979575168:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335655:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335673:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979575680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335738:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979575296:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335787:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383256.335793:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979575424:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.335846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383256.335909:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575040 00000100:00100000:0.0:1787383256.335920:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575040 00000100:00100000:0.0:1787383256.335984:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787383256.335995:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979575040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336068:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979575040:12345-0@lo:400:kworker.0 Request processed in 74us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336076:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787383256.336126:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575552 00000100:00100000:0.0:1787383256.336131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575552 00000100:00100000:0.0:1787383256.336171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575168 00000100:00100000:0.0:1787383256.336181:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575168 00000100:00100000:0.0:1787383256.336197:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575296 00000100:00100000:0.0:1787383256.336199:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575296 00000100:00100000:0.0:1787383256.336221:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383256.336227:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979575552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336265:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979575552:12345-0@lo:400:kworker.0 Request processed in 37us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336272:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383256.336285:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787383256.336292:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979575168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336322:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979575168:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336328:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787383256.336338:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787383256.336344:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979575296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336375:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979575296:12345-0@lo:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336381:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787383256.336404:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575680 00000100:00100000:0.0:1787383256.336407:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575680 00000100:00100000:0.0:1787383256.336436:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575424 00000100:00100000:0.0:1787383256.336440:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575424 00000100:00100000:0.0:1787383256.336456:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383256.336463:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979575680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336497:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979575680:12345-0@lo:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336503:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383256.336522:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383256.336528:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979575424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336555:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979575424:12345-0@lo:400:kworker.0 Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383256.336562:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787383256.336591:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383256.336596:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383256.336600:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787383256.336638:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c869180 x1874206979575424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383256.336655:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979575424:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336669:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979575296:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336700:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979575168:0@lo:400:kworker.0 00010000:00080000:0.0:1787383256.336709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c86a300 x1874206979575680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383256.336718:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979575680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336725:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979575040:0@lo:400:kworker.0 00000100:00100000:0.0:1787383256.336735:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979575552:0@lo:400:kworker.0 00000100:00100000:2.0:1787383256.842219:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979575808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383256.842328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383256.842501:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575808 00000100:00100000:1.0:1787383256.842512:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575808 00000100:00100000:1.0:1787383256.842590:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383256.842602:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979575808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383256.842661:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383256.842727:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979575808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383256.842736:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787383256.842789:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d714380 x1874206979575808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383256.842810:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979575808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787383256.910507:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787383257.355462:0:6793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 281569590559ns, next at 282569586732ns, rc = 0 00000100:00100000:2.0:1787383257.355507:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979575936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383257.355604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383257.355696:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979575936 00000100:00100000:2.0:1787383257.355705:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979575936 00000100:00100000:2.0:1787383257.355763:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383257.355773:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979575936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383257.355833:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383257.355909:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979575936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383257.355917:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787383257.355974:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b5500 x1874206979575936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383257.355994:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979575936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787383257.930133:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383258.955033:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383259.304577:0:11478:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787383259.633719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383259.633765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383259.633794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383259.633826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383259.633900:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767104 00000100:00100000:0.0:1787383259.633913:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767104 00000100:00100000:1.0:1787383259.633943:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767360 00000100:00100000:1.0:1787383259.633948:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767360 00000100:00100000:3.0:1787383259.634068:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962766976 00000100:00100000:3.0:1787383259.634078:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962766976 00000100:00100000:3.0:1787383259.634120:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 248 00000100:00100000:3.0:1787383259.634132:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962766976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383259.634230:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962766976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 100us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383259.634250:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 248 00000100:00100000:0.0:1787383259.638198:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1787383259.638231:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962767360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383259.638333:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962767360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 122us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.638341:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1787383259.638367:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1787383259.638374:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2351:x1874206962767104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383259.638402:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2351:x1874206962767104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.638408:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1787383259.643578:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767232 00000100:00100000:0.0:1787383259.643600:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767232 00000100:00100000:0.0:1787383259.643700:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1787383259.643715:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962767232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383259.643822:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962767232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 112us (9994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.643831:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00080000:0.0:1787383259.643957:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383259.643964:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383259.980777:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383260.253956:0:11526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd6e254560 00000020:00000080:3.0:1787383260.253972:0:11526:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383260.253977:0:11526:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383260.253985:0:11526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6e2567f0 20000000:00000080:3.0:1787383260.253992:0:11526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffb0129d000 uarg=0000000000000000 20000000:01000000:3.0:1787383260.254041:0:11526:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787383260.254047:0:11526:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787383260.254054:0:11526:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787383260.255082:0:11527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787383260.255388:0:11526:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787383260.261330:0:11526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787383260.261414:0:11526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787383260.261478:0:11526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787383260.261496:0:11526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787383260.261517:0:11526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261535:0:11526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261542:0:11526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261550:0:11526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261555:0:11526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261561:0:11526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261568:0:11526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261605:0:11526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261620:0:11526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 18 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.261634:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576064:0@lo:104: 00000100:00100000:1.0:1787383260.261698:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383260.261752:0:11526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261760:0:11526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.261768:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576192:0@lo:104: 00000100:00100000:1.0:1787383260.261788:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383260.261818:0:11526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261826:0:11526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 18 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.261833:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576320:0@lo:104: 00000100:00100000:1.0:1787383260.261853:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383260.261893:0:11526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261903:0:11526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 12 pid: 5796 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.261912:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576448:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383260.261962:0:11526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.261970:0:11526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 12 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.261978:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576576:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383260.262005:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383260.262261:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787383260.262275:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576064 00000100:00100000:3.0:1787383260.262282:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576064 00000100:00100000:3.0:1787383260.262321:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576192 00000100:00100000:3.0:1787383260.262324:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576192 00000100:00100000:3.0:1787383260.262334:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576320 00000100:00100000:3.0:1787383260.262336:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576320 00000100:00100000:3.0:1787383260.262348:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383260.262357:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:11526:x1874206979576064:12345-0@lo:104: 00010000:00010000:3.0:1787383260.262369:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262440:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383260.262446:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+5:11526:x1874206979576064:12345-0@lo:104: Request processed in 90us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383260.262459:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383260.262477:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383260.262484:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:11526:x1874206979576192:12345-0@lo:104: 00010000:00010000:3.0:1787383260.262491:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262526:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383260.262531:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+4:11526:x1874206979576192:12345-0@lo:104: Request processed in 49us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383260.262537:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383260.262549:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383260.262556:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2fd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:11526:x1874206979576320:12345-0@lo:104: 00010000:00010000:3.0:1787383260.262567:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262597:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787383260.262601:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2fd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+3:11526:x1874206979576320:12345-0@lo:104: Request processed in 47us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383260.262606:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787383260.262643:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787383260.262649:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262656:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383260.262659:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262677:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383260.262683:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383260.262688:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383260.262715:0:11031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262721:0:11031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383260.262742:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262749:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01515c00/0x42020b050d5ceb90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262764:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383260.262767:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262771:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383260.262774:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262781:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383260.262786:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383260.262796:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383260.262810:0:11031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262816:0:11031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383260.262822:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262827:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01514800/0x42020b050d5ceb82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb89 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262836:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383260.262840:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262844:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383260.262847:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.262852:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383260.262858:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383260.262862:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383260.262898:0:11031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263083:0:11031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383260.263109:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263115:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01515a00/0x42020b050d5ceb74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5ceb7b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263128:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383260.263130:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383260.263132:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383260.263138:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383260.263157:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979576704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383260.263191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383260.263221:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383260.263228:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979576832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383260.263249:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383260.263279:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576704 00000100:00100000:3.0:1787383260.263283:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576704 00010000:00010000:3.0:1787383260.263302:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 19 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383260.263321:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576832 00000100:00100000:3.0:1787383260.263324:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576832 00010000:00010000:3.0:1787383260.263335:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 20 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383260.263352:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383260.263359:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+20:3314:x1874206979576704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383260.263368:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383260.263373:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 20 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.263607:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576064:0@lo:104: 00000100:00100000:1.0:1787383260.263617:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576192:0@lo:104: 00000100:00100000:1.0:1787383260.263626:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576320:0@lo:104: 00010000:00010000:3.0:1787383260.263678:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 20 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263691:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5ceb97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb90 expref: 20 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263704:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383260.263781:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979576704:12345-0@lo:103:ldlm_bl.0 Request processed in 422us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383260.263788:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383260.263803:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383260.263809:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3314:x1874206979576832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383260.263817:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383260.263822:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263830:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263840:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99200/0x42020b050d5ceb89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb82 expref: 18 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.263847:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383260.263891:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3314:x1874206979576832:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383260.263897:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1787383260.264389:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383260.264525:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979576960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383260.264562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383260.264705:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979576704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383260.264725:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979576832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383260.264808:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979576960 00000100:00100000:0.0:1787383260.264814:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979576960 00010000:00010000:0.0:1787383260.264838:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383260.264939:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787383260.264948:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3312:x1874206979576960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383260.264970:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383260.264976:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383260.264987:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383260.264999:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99000/0x42020b050d5ceb7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5ceb74 expref: 17 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383260.265021:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383260.265059:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3312:x1874206979576960:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383260.265066:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383260.265156:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979576960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383260.267717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383260.267795:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767488 00000100:00100000:0.0:1787383260.267802:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767488 00010000:00010000:0.0:1787383260.267837:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 13 pid: 5796 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383260.267911:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1787383260.267920:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962767488:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383260.267933:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383260.267938:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 13 pid: 5796 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383260.267950:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 13 pid: 5796 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383260.267970:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383260.268044:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962767488:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 125us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383260.268052:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1787383260.269823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383260.270032:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767616 00000100:00100000:2.0:1787383260.270042:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767616 00010000:00010000:2.0:1787383260.270076:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 13 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383260.270148:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1787383260.270158:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962767616:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383260.270171:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383260.270191:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 13 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270214:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 13 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270236:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270243:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270261:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270267:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270274:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270281:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270288:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383260.270293:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270300:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270309:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383260.270328:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383260.270383:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962767616:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 226us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383260.270784:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:1.0:1787383260.270929:0:11526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01514e00/0x42020b050d5ceb6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0b5 expref: 12 pid: 5796 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.270945:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576448:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383260.270958:0:11526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047000/0x42020b050d5ceb66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b0ae expref: 11 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383260.270965:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c953480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11526:1874206979576576:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383260.270996:0:11526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.271015:0:11526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.271023:0:11526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383260.271029:0:11526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecc4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383260.480775:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:3.0:1787383260.480817:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787383260.480836:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1787383260.480979:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979577088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787383260.481061:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383260.481137:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577088 00000100:00100000:3.0:1787383260.481144:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577088 00000100:00100000:3.0:1787383260.481196:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383260.481207:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979577088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787383260.481235:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787383260.481273:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a894dd7, atime: 0x6a894dd7, ctime: 0x6a894dd7, blocks: 0x1 00010000:00010000:3.0:1787383260.481282:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.481298:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=284s v=(0 0) 00010000:00010000:3.0:1787383260.481303:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383260.481309:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.481326:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.481337:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.481346:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.481377:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383260.481952:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979577088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 744us (888us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787383260.481960:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787383260.481985:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787383260.481997:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383260.482003:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.482026:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383260.482031:0:11031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.482041:0:11031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.482059:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.482065:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5ceccb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383260.482084:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383260.482086:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383260.482087:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787383260.482119:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc34c46a00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787383260.482132:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979577088:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787383260.482165:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787383261.002125:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383261.453157:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383261.453229:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383261.453251:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979577344:0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.453326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383261.453612:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577344 00000100:00100000:0.0:1787383261.453621:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577344 00000100:00100000:0.0:1787383261.453687:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383261.453696:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979577344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383261.453752:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979577344:12345-0@lo:400:kworker.0 Request processed in 56us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.453759:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787383261.453847:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979577344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.454035:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979577216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.454075:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383261.454150:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577216 00000100:00100000:0.0:1787383261.454155:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577216 00000100:00100000:0.0:1787383261.454189:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787383261.454196:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3315:x1874206979577216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383261.454242:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3315:x1874206979577216:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.454249:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787383261.454323:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979577216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.454554:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979577856:0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.454585:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383261.454612:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383261.454618:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979577728:0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.454649:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383261.454762:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577856 00000100:00100000:2.0:1787383261.454767:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577856 00000100:00100000:2.0:1787383261.454811:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383261.454819:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979577856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383261.454856:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979577856:12345-0@lo:400:kworker.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383261.454862:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787383261.454936:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787383261.454959:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc171b4e00 x1874206979577856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383261.454970:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979577856:0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.455046:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979577600:0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.455073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.455100:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383261.455106:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979577472:0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.455126:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.455159:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577600 00000100:00100000:3.0:1787383261.455163:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577600 00000100:00100000:3.0:1787383261.455190:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787383261.455197:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979577600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383261.455230:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979577600:12345-0@lo:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383261.455236:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787383261.455261:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979577600:0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.455320:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577728 00000100:00100000:1.0:1787383261.455324:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577728 00000100:00100000:1.0:1787383261.455358:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577472 00000100:00100000:1.0:1787383261.455361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577472 00000100:00100000:1.0:1787383261.455382:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787383261.455388:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979577728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.455421:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979577728:12345-0@lo:400:kworker.0 Request processed in 33us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.455427:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787383261.455441:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787383261.455460:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979577472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383261.455489:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979577472:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.455494:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787383261.455522:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979577728:0@lo:400:kworker.0 00000100:00080000:3.0:1787383261.455740:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383261.455761:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979577472:0@lo:400:kworker.0 10000000:01000000:3.0:1787383261.641989:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383261.642007:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3ff86800 from 7 10000000:01000000:3.0:1787383261.642012:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383261.642060:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.642090:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.642101:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383261.642125:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979577984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.642198:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.642256:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.642560:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979577984 00000100:00100000:0.0:1787383261.642568:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979577984 00000100:00100000:0.0:1787383261.642619:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787383261.642628:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:5800:x1874206979577984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383261.642641:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383261.642654:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047a00/0x42020b050d5cecd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cecd2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.642677:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047a00/0x42020b050d5cecd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cecd2 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.642693:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047a00/0x42020b050d5cecd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cecd2 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.642702:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047a00, rc 0) 00000100:00100000:0.0:1787383261.642746:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979577984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.642753:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787383261.642905:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979577984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383261.642921:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.642931:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383261.642982:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.643019:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.643047:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383261.643095:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578112 00000100:00100000:2.0:1787383261.643100:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578112 00000100:00100000:2.0:1787383261.643131:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787383261.643138:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979578112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383261.643414:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979578112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383261.643421:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787383261.643606:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.643638:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.643676:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.643700:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383261.643754:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578240 00000100:00100000:1.0:1787383261.643759:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578240 00000100:00100000:1.0:1787383261.643792:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787383261.643800:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979578240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383261.643976:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979578240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.643983:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787383261.644456:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.649793:0:11540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11540:1874206979578368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383261.649914:0:11540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.649963:0:11540:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383261.650031:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578368 00000100:00100000:1.0:1787383261.650040:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578368 00000100:00100000:1.0:1787383261.650090:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787383261.650100:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:11540:x1874206979578368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383261.650517:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:11540:x1874206979578368:12345-0@lo:502:llog_process_th.0 Request processed in 417us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.650526:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787383261.650629:0:11540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11540:1874206979578368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383261.650660:0:11540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383261.650669:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383261.650672:0:11540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383261.650678:0:11540:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffc3ff86800 00000020:00000080:3.0:1787383261.650681:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383261.650776:0:11540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11540:1874206979578496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383261.650814:0:11540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.650948:0:11540:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.657965:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578496 00000100:00100000:0.0:1787383261.657985:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578496 00000100:00100000:0.0:1787383261.658065:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787383261.658076:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:11540:x1874206979578496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383261.659347:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:11540:x1874206979578496:12345-0@lo:502:llog_process_th.0 Request processed in 1266us (8525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.659370:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787383261.661101:0:11540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11540:1874206979578496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383261.661145:0:11540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383261.661162:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383261.661165:0:11540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787383261.661169:0:11540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787383261.669093:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787383261.669135:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383261.669149:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.672264:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383261.672278:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383261.672281:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc3dc13000 from 7 10000000:01000000:3.0:1787383261.672285:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383261.672327:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.672336:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.672346:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383261.672379:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.672449:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.672505:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.672929:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578624 00000100:00100000:0.0:1787383261.672938:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578624 00000100:00100000:0.0:1787383261.673002:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787383261.673012:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:5800:x1874206979578624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383261.673026:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383261.673040:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046000/0x42020b050d5cece7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cece0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.673063:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046000/0x42020b050d5cece7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cece0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.673074:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046000/0x42020b050d5cece7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cece0 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.673094:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046000, rc 0) 00000100:00100000:0.0:1787383261.673149:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc20b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979578624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.673164:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787383261.673342:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383261.673568:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383261.673578:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383261.673643:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383261.673683:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383261.673714:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e591240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.673762:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578752 00000100:00100000:0.0:1787383261.673766:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578752 00000100:00100000:0.0:1787383261.673799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787383261.673807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979578752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.674102:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979578752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.674111:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787383261.674199:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.674234:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.674272:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.674312:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.674471:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979578880 00000100:00100000:0.0:1787383261.674476:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979578880 00000100:00100000:0.0:1787383261.674511:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787383261.674519:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979578880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.674666:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979578880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.674673:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787383261.674903:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979578880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383261.675427:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11543:1874206979579008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383261.675473:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383261.675546:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.680719:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579008 00000100:00100000:0.0:1787383261.680734:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579008 00000100:00100000:0.0:1787383261.680790:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787383261.680800:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:11543:x1874206979579008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383261.681132:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:11543:x1874206979579008:12345-0@lo:502:llog_process_th.0 Request processed in 332us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.681141:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787383261.681208:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11543:1874206979579008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383261.681255:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383261.681265:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383261.681267:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383261.681274:0:11543:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffc3dc13000 00000020:00000080:1.0:1787383261.681276:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383261.681444:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11543:1874206979579136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383261.681483:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383261.681508:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579136 00000100:00100000:0.0:1787383261.681511:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579136 00000100:00100000:0.0:1787383261.681535:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787383261.681541:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:11543:x1874206979579136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383261.681727:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.681733:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17082850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:11543:x1874206979579136:12345-0@lo:502:llog_process_th.0 Request processed in 192us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.681740:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11543:1874206979579136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383261.681740:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000020:01000000:1.0:1787383261.681758:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383261.681762:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383261.681764:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787383261.681767:0:11543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787383261.681851:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787383261.681896:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383261.681907:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.681918:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383261.681928:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383261.681931:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc2750b800 from 7 10000000:01000000:0.0:1787383261.681933:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383261.681956:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.681964:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.681973:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383261.681987:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.682032:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383261.682439:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579264 00000100:00100000:1.0:1787383261.682444:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579264 00000100:00100000:0.0:1787383261.682447:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383261.682466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787383261.682473:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:5800:x1874206979579264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383261.682483:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383261.682494:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cecee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383261.682516:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cecee expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383261.682526:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cecee expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383261.682535:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a600, rc 0) 00000100:00100000:1.0:1787383261.682570:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979579264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.682575:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787383261.682752:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383261.682764:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383261.682773:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383261.682813:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.682836:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383261.682864:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a780 going to sleep for 11 seconds 00000040:00080000:3.0:1787383261.683153:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383261.683498:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579392 00000100:00100000:1.0:1787383261.683504:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579392 00000100:00100000:1.0:1787383261.683540:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787383261.683547:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979579392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383261.683930:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17083050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979579392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.683938:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787383261.683948:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.683985:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383261.684032:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383261.684070:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383261.684109:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579520 00000100:00100000:1.0:1787383261.684114:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579520 00000100:00100000:1.0:1787383261.684150:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787383261.684166:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979579520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383261.684491:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17081850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:5800:x1874206979579520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383261.684498:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787383261.684512:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:5800:1874206979579520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383261.686288:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11545:1874206979579648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383261.686432:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383261.686474:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383261.686767:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579648 00000100:00100000:0.0:1787383261.686773:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579648 00000100:00100000:0.0:1787383261.686822:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787383261.686831:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:11545:x1874206979579648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383261.687077:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:11545:x1874206979579648:12345-0@lo:502:llog_process_th.0 Request processed in 246us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383261.687084:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787383261.687106:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11545:1874206979579648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383261.687135:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383261.687144:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383261.687146:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383261.687152:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffc2750b800 00000020:00000080:1.0:1787383261.687448:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787383261.687521:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11545:1874206979579776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383261.687557:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383261.687589:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc03ec8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383261.687805:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579776 00000100:00100000:3.0:1787383261.687810:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579776 00000100:00100000:3.0:1787383261.687845:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787383261.687853:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:11545:x1874206979579776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383261.688039:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc17080c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:11545:x1874206979579776:12345-0@lo:502:llog_process_th.0 Request processed in 185us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383261.688045:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787383261.688130:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:11545:1874206979579776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383261.688149:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383261.688166:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383261.688168:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787383261.688172:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787383261.689452:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787383261.689485:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383261.689497:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383261.689523:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383261.962147:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979579904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383261.962238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383261.962409:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979579904 00000100:00100000:2.0:1787383261.962418:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979579904 00000100:00100000:2.0:1787383261.962462:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383261.962472:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979579904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383261.962507:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383261.962551:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979579904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383261.962559:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787383261.963036:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c950380 x1874206979579904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383261.963055:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979579904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383262.000610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383262.000855:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767744 00000100:00100000:0.0:1787383262.000897:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767744 00000100:00100000:0.0:1787383262.000968:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 265 00000100:00100000:0.0:1787383262.000980:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:5563:x1874206962767744:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383262.001011:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383262.001036:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046e00/0x42020b050d5cecfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b102 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383262.001074:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046e00/0x42020b050d5cecfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b102 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383262.001087:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046e00/0x42020b050d5cecfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b102 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383262.001099:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046e00, rc 0) 00000100:00100000:0.0:1787383262.001180:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962767744:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 202us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383262.001189:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 265 00000100:00100000:0.0:1787383262.003851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383262.003946:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962767872 00000100:00100000:1.0:1787383262.003960:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962767872 00000100:00100000:1.0:1787383262.004039:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 266 00000100:00100000:1.0:1787383262.004049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962767872:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383262.004727:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962767872:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 674us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383262.004736:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 266 00000100:00100000:1.0:1787383262.008197:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383262.011088:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768000 00000100:00100000:3.0:1787383262.011110:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768000 00000100:00100000:3.0:1787383262.011312:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 267 00000100:00100000:3.0:1787383262.011327:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962768000:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383262.011702:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962768000:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 376us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383262.011712:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 267 00000100:00100000:2.0:1787383262.016988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383262.017202:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768128 00000100:00100000:1.0:1787383262.017214:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768128 00000100:00100000:1.0:1787383262.017270:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 268 00000100:00100000:1.0:1787383262.017281:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:9928:x1874206962768128:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383262.017536:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:9928:x1874206962768128:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 256us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383262.017546:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 268 00000100:00100000:1.0:1787383262.026466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1787383262.026711:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383262.028949:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768256 00000100:00100000:3.0:1787383262.028965:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768256 00000100:00100000:2.0:1787383262.029801:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 269 00000100:00100000:2.0:1787383262.029815:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:9928:x1874206962768256:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383262.030275:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:9928:x1874206962768256:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 461us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383262.030283:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 269 00000100:00100000:0.0:1787383262.038421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383262.038572:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768384 00000100:00100000:1.0:1787383262.038586:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768384 00000100:00100000:1.0:1787383262.038658:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 270 00000100:00100000:1.0:1787383262.038669:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:5563:x1874206962768384:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383262.038691:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383262.038734:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a400/0x42020b050d5ced03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b109 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383262.038774:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a400/0x42020b050d5ced03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b109 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383262.038787:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6a400/0x42020b050d5ced03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b109 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383262.038798:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a400, rc 0) 00000100:00100000:1.0:1787383262.038915:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962768384:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 246us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383262.038923:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 270 00000100:00100000:3.0:1787383262.047181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383262.047472:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768512 00000100:00100000:0.0:1787383262.047482:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768512 00000100:00100000:0.0:1787383262.047571:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 271 00000100:00100000:0.0:1787383262.047581:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962768512:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383262.047913:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962768512:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 331us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383262.047921:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 271 00000100:00100000:0.0:1787383262.051108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383262.054503:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768640 00000100:00100000:2.0:1787383262.054519:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768640 00000100:00100000:2.0:1787383262.054605:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 272 00000100:00100000:2.0:1787383262.054616:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962768640:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383262.054849:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:5563:x1874206962768640:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 234us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383262.054857:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 272 00000100:00100000:2.0:1787383262.060366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383262.060483:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768768 00000100:00100000:1.0:1787383262.060493:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768768 00000100:00100000:1.0:1787383262.060569:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 273 00000100:00100000:1.0:1787383262.060580:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:9931:x1874206962768768:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383262.060918:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:9931:x1874206962768768:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 339us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383262.060927:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 273 00000100:00100000:2.0:1787383262.070899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383262.071058:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962768896 00000100:00100000:0.0:1787383262.071069:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962768896 00000100:00100000:0.0:1787383262.071130:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 274 00000100:00100000:0.0:1787383262.071140:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:9931:x1874206962768896:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383262.071400:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:9931:x1874206962768896:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 261us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383262.071408:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 274 00000100:00100000:3.0:1787383262.474454:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979580032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383262.474528:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383262.474654:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580032 00000100:00100000:2.0:1787383262.474661:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580032 00000100:00100000:2.0:1787383262.474730:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383262.474739:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979580032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383262.474773:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383262.474812:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979580032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383262.474819:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787383262.474891:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383262.475004:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979580032:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787383262.731204:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383263.050130:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383264.074837:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383264.755587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383264.755646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383264.755720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383264.755759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383264.755796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769152 00000100:00100000:0.0:1787383264.755804:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769408 00000100:00100000:1.0:1787383264.755807:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769152 00000100:00100000:0.0:1787383264.755809:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769408 00000100:00100000:2.0:1787383264.755891:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769024 00000100:00100000:2.0:1787383264.755896:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769024 00000100:00100000:1.0:1787383264.755902:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1787383264.755914:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769152:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383264.755926:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 275 00000100:00100000:2.0:1787383264.755933:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962769024:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383264.756002:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962769024:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.756011:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 275 00000100:00100000:1.0:1787383264.756038:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769152:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383264.756061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00080000:2.0:1787383264.756256:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383264.756584:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:0.0:1787383264.756594:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962769408:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383264.756643:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962769408:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 51us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383264.756650:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:3.0:1787383264.757301:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769280 00000100:00100000:3.0:1787383264.757309:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769280 00000100:00100000:3.0:1787383264.757505:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1787383264.757517:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769280:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383264.757587:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769280:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383264.757594:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:2.0:1787383264.761423:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787383265.098972:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787383265.595297:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787383266.123119:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383266.570295:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979580416:0@lo:400:kworker.0 00000100:00100000:0.0:1787383266.570369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383266.570428:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383266.570435:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979580544:0@lo:400:kworker.0 00000100:00100000:0.0:1787383266.570473:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383266.570736:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580544 00000100:00100000:2.0:1787383266.570745:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580544 00000100:00100000:2.0:1787383266.570811:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787383266.570822:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383266.570895:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979580544:12345-0@lo:400:kworker.0 Request processed in 75us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383266.570903:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787383266.570971:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787383266.570977:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc34c46a00, transno 4294967300 00000100:00100000:2.0:1787383266.570991:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979580544:0@lo:400:kworker.0 00000100:00080000:0.0:1787383266.571493:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383266.571658:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979580160:0@lo:400:kworker.0 00000100:00100000:1.0:1787383266.571703:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383266.571742:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979580672:0@lo:400:kworker.0 00000100:00100000:1.0:1787383266.571767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383266.571795:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383266.571802:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979580288:0@lo:400:kworker.0 00000100:00100000:1.0:1787383266.571823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383266.571840:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979580800:0@lo:400:kworker.0 00000100:00100000:1.0:1787383266.571860:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383266.571892:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580416 00000100:00100000:3.0:1787383266.571897:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580416 00000100:00100000:1.0:1787383266.571912:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580672 00000100:00100000:1.0:1787383266.571915:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580672 00000100:00100000:3.0:1787383266.571928:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580288 00000100:00100000:3.0:1787383266.571930:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580288 00000100:00100000:1.0:1787383266.571932:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383266.571938:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979580416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.571944:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383266.571963:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383266.571991:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979580416:12345-0@lo:400:kworker.0 Request processed in 52us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.571992:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979580672:12345-0@lo:400:kworker.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383266.571998:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383266.572079:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580160 00000100:00100000:0.0:1787383266.572084:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580160 00000100:00100000:0.0:1787383266.572112:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787383266.572119:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979580160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383266.572150:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979580160:12345-0@lo:400:kworker.0 Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383266.572155:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787383266.572559:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383266.572579:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383266.572587:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979580288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.572619:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979580288:12345-0@lo:400:kworker.0 Request processed in 35us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.572625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383266.572686:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580800 00000100:00100000:3.0:1787383266.572690:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580800 00000100:00100000:3.0:1787383266.572716:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383266.572723:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979580800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.572755:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979580800:12345-0@lo:400:kworker.0 Request processed in 33us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.572760:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383266.572796:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979580416:0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.572842:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979580288:0@lo:400:kworker.0 00010000:00080000:3.0:1787383266.572854:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc34c40380 x1874206979580800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383266.572911:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979580800:0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.572923:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979580160:0@lo:400:kworker.0 00000100:00100000:3.0:1787383266.572934:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979580672:0@lo:400:kworker.0 00000100:00080000:3.0:1787383266.572984:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383266.572989:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383267.082198:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383267.082222:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979580928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383267.082290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383267.082717:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979580928 00000100:00100000:2.0:1787383267.082727:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979580928 00000100:00100000:2.0:1787383267.082781:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787383267.082792:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979580928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383267.082829:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383267.082902:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979580928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.082909:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787383267.083003:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1ce00 x1874206979580928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383267.083022:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979580928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383267.146085:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383267.595458:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979581056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383267.595558:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383267.595911:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581056 00000100:00100000:2.0:1787383267.595921:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581056 00000100:00100000:2.0:1787383267.595988:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383267.595998:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979581056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383267.596036:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383267.596096:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979581056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.596102:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383267.596225:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979581056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787383268.170333:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383269.194497:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383269.871790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383269.872727:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769536 00000100:00100000:1.0:1787383269.872740:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769536 00000100:00100000:1.0:1787383269.872818:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 277 00000100:00100000:1.0:1787383269.872827:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962769536:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383269.872950:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962769536:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 123us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.872959:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 277 00000100:00100000:3.0:1787383269.873747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383269.873905:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769664 00000100:00100000:1.0:1787383269.873915:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769664 00000100:00100000:1.0:1787383269.874050:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:1.0:1787383269.874060:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769664:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383269.874109:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769664:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 51us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.874116:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1787383269.879084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00080000:0.0:1787383269.879226:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383269.879463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383269.879583:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769920 00000100:00100000:0.0:1787383269.879607:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769920 00000100:00100000:2.0:1787383269.879674:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962769792 00000100:00100000:2.0:1787383269.879684:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962769792 00000100:00100000:0.0:1787383269.879710:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:0.0:1787383269.879728:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962769920:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383269.879753:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1787383269.879767:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769792:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1787383269.880006:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383269.880014:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383269.880069:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962769920:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 346us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383269.880079:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:2.0:1787383269.880470:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962769792:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 702us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383269.880523:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:3.0:1787383270.218189:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383271.242133:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383271.690443:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979581184:0@lo:400:kworker.0 00000100:00100000:3.0:1787383271.690520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383271.690646:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979581312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.690691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383271.690740:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581312 00000100:00100000:0.0:1787383271.690746:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581312 00000100:00100000:0.0:1787383271.690783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383271.690790:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.690835:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979581312:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383271.690841:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383271.690891:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979581312:0@lo:400:kworker.0 00000100:00100000:2.0:1787383271.691483:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581184 00000100:00100000:2.0:1787383271.691489:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581184 00000100:00100000:2.0:1787383271.691519:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787383271.691526:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979581184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383271.691956:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979581824:0@lo:400:kworker.0 00000100:00100000:1.0:1787383271.691989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383271.692013:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383271.692019:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979581696:0@lo:400:kworker.0 00000100:00100000:1.0:1787383271.692041:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383271.692067:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581696 00000100:00100000:1.0:1787383271.692071:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581696 00000100:00100000:1.0:1787383271.692117:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787383271.692127:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979581696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383271.692163:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979581696:12345-0@lo:400:kworker.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383271.692170:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787383271.692191:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383271.692215:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979581696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.692338:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979581440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.692366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383271.692392:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383271.692397:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979581568:0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.692429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383271.692468:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581824 00000100:00100000:0.0:1787383271.692472:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581824 00000100:00100000:0.0:1787383271.692507:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581568 00000100:00100000:0.0:1787383271.692510:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581568 00000100:00100000:0.0:1787383271.692526:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383271.692532:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979581824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.692565:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979581824:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383271.692571:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383271.692583:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383271.692589:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979581568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383271.692619:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979581568:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383271.692637:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383271.692669:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979581568:0@lo:400:kworker.0 00000100:00080000:1.0:1787383271.692807:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383271.692810:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383271.692818:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581440 00000100:00100000:1.0:1787383271.692821:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581440 00000100:00100000:1.0:1787383271.692861:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787383271.692882:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979581440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383271.692927:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979581440:12345-0@lo:400:kworker.0 Request processed in 61us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383271.692933:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787383271.692961:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979581440:0@lo:400:kworker.0 00010000:00080000:1.0:1787383271.692985:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1ca80 x1874206979581824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383271.692995:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979581824:0@lo:400:kworker.0 00000100:00080000:0.0:1787383271.693548:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383271.693682:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979581184:12345-0@lo:400:kworker.0 Request processed in 2155us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383271.693691:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787383271.693806:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979581184:0@lo:400:kworker.0 00000100:00100000:1.0:1787383272.203375:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383272.203398:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979581952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383272.203467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383272.203928:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979581952 00000100:00100000:2.0:1787383272.203938:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979581952 00000100:00100000:2.0:1787383272.204008:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383272.204018:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979581952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383272.204056:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383272.204115:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979581952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383272.204122:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787383272.204353:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1ca80 x1874206979581952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383272.204373:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979581952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383272.266162:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383272.714968:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383272.714995:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979582080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383272.715084:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383272.715464:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582080 00000100:00100000:2.0:1787383272.715473:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582080 00000100:00100000:2.0:1787383272.715527:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383272.715537:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979582080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383272.715576:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383272.715626:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979582080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383272.715633:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383272.715683:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979582080:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787383272.970615:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383273.290114:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383274.314242:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383274.994539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383274.994587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383274.994721:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770048 00000100:00100000:0.0:1787383274.994732:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770048 00000100:00100000:0.0:1787383274.994790:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 279 00000100:00100000:0.0:1787383274.994800:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962770048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383274.994909:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962770048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383274.994916:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 279 00000100:00100000:2.0:1787383275.001037:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770176 00000100:00100000:2.0:1787383275.001053:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770176 00000100:00100000:2.0:1787383275.001144:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1787383275.001164:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962770176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383275.001249:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962770176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 88us (6661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383275.001257:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00080000:0.0:1787383275.001656:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383275.007373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383275.007685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383275.007926:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770304 00000100:00100000:3.0:1787383275.007950:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770304 00000100:00100000:3.0:1787383275.008034:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1787383275.008048:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2347:x1874206962770304:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1787383275.008081:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cec3f 00000100:00080000:3.0:1787383275.008091:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc170ed000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383275.008134:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787383275.008477:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+2:2347:x1874206962770304:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 432us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383275.008559:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:3.0:1787383275.008587:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383275.009227:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383275.009677:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770432 00000100:00100000:0.0:1787383275.009686:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770432 00000100:00100000:0.0:1787383275.009853:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1787383275.009863:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962770432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383275.009995:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962770432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 134us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383275.010002:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00080000:1.0:1787383275.011164:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383275.341467:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383275.870247:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:2.0:1787383275.870258:0:6624:0:(genops.c:906:class_export_put()) final put ffff9ffc3ff83000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:0.0:1787383275.870378:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3ff83000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-OST0000 00000020:00000080:0.0:1787383275.871085:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc170ed000 for lustre-OST0000 00010000:00010000:0.0:1787383276.363122:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383276.810188:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979582592:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.810279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383276.810342:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383276.810348:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979582464:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.810372:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383276.810404:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582592 00000100:00100000:0.0:1787383276.810411:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582592 00000100:00100000:0.0:1787383276.810465:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383276.810473:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979582592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.810519:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979582592:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383276.810526:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787383276.810968:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383276.811019:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cfff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979582592:0@lo:400:kworker.0 00000100:00100000:1.0:1787383276.811235:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979582336:0@lo:400:kworker.0 00000100:00100000:1.0:1787383276.811271:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383276.811769:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979582208:0@lo:400:kworker.0 00000100:00100000:3.0:1787383276.811809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383276.811839:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979582720:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.812285:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582464 00000100:00100000:0.0:1787383276.812291:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582464 00000100:00100000:0.0:1787383276.812357:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787383276.812366:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979582464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.812421:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979582464:12345-0@lo:400:kworker.0 Request processed in 56us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383276.812428:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787383276.812510:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582208 00000100:00100000:2.0:1787383276.812515:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582208 00000100:00100000:2.0:1787383276.812540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787383276.812547:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979582208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383276.812596:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc170d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979582208:12345-0@lo:400:kworker.0 Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383276.812602:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1787383276.813248:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383276.814218:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979582848:0@lo:400:kworker.0 00000100:00100000:1.0:1787383276.814467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383276.814528:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582848 00000100:00100000:1.0:1787383276.814534:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582848 00000100:00100000:1.0:1787383276.814598:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383276.814608:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979582848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383276.814656:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979582848:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383276.814662:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787383276.814837:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787383276.814891:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c868e00 x1874206979582848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383276.814904:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979582848:0@lo:400:kworker.0 00000100:00100000:3.0:1787383276.815001:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383276.815260:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979582208:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.815515:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582336 00000100:00100000:0.0:1787383276.815521:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582336 00000100:00100000:0.0:1787383276.815543:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582720 00000100:00100000:0.0:1787383276.815546:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582720 00000100:00100000:0.0:1787383276.815585:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787383276.815592:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979582336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.815645:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979582336:12345-0@lo:400:kworker.0 Request processed in 53us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383276.815664:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787383276.815694:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787383276.815701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979582720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.815737:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979582720:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383276.815743:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787383276.815764:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383276.815788:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979582720:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.815813:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979582336:0@lo:400:kworker.0 00000100:00100000:0.0:1787383276.815849:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979582464:0@lo:400:kworker.0 00000100:00100000:2.0:1787383277.322192:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979582976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383277.322280:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383277.323099:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979582976 00000100:00100000:3.0:1787383277.323110:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979582976 00000100:00100000:3.0:1787383277.323175:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383277.323391:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979582976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383277.323444:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383277.323526:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979582976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1245us total) trans 0 rc 0/0 00010000:00080000:2.0:1787383277.323894:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1d500 x1874206979582976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383277.323916:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979582976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383277.327086:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1787383277.388910:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383277.834903:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979583104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383277.834985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383277.835474:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583104 00000100:00100000:3.0:1787383277.835483:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583104 00000100:00100000:3.0:1787383277.835546:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383277.835556:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979583104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383277.835590:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383277.842412:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979583104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6848us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.842429:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383277.850338:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979583104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383278.410265:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383279.434440:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383280.114556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383280.114608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383280.114691:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770816 00000100:00100000:0.0:1787383280.114693:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770560 00000100:00100000:0.0:1787383280.114704:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770560 00000100:00100000:2.0:1787383280.114707:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770816 00000100:00100000:2.0:1787383280.114760:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1787383280.114760:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 281 00000100:00100000:2.0:1787383280.114770:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962770816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383280.114770:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962770560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1787383280.114850:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383280.114861:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962770816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383280.114912:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1787383280.118458:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962770560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 3675us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383280.118473:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 281 00000100:00100000:0.0:1787383280.121216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383280.121324:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770688 00000100:00100000:1.0:1787383280.121334:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770688 00000100:00100000:1.0:1787383280.121406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1787383280.121416:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962770688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383280.121497:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962770688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 83us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383280.121504:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00080000:0.0:1787383280.121747:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383280.458249:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383281.482565:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383281.933585:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.933654:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934508:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979583872:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.934542:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934580:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787383281.934587:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.934614:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934637:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979583744:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.934658:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934703:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979583488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.934725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934744:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383281.934750:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979583616:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.934771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.934803:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583360 00000100:00100000:3.0:1787383281.934822:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583360 00000100:00100000:3.0:1787383281.934864:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583744 00000100:00100000:3.0:1787383281.934894:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583744 00000100:00100000:3.0:1787383281.934920:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583488 00000100:00100000:3.0:1787383281.934923:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583488 00000100:00100000:3.0:1787383281.934942:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787383281.934950:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.935003:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979583360:12345-0@lo:400:kworker.0 Request processed in 53us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.935011:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787383281.935027:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383281.935034:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979583744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.935062:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979583744:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.935068:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383281.935081:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787383281.935087:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.935118:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979583488:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.935124:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787383281.935141:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583872 00000100:00100000:3.0:1787383281.935145:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583872 00000100:00100000:3.0:1787383281.935170:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583616 00000100:00100000:3.0:1787383281.935173:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583616 00000100:00100000:3.0:1787383281.935188:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383281.935195:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979583872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.935224:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979583872:12345-0@lo:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.935231:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383281.935249:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383281.935255:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979583616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.935285:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979583616:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.935291:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383281.935308:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979583232 00000100:00100000:3.0:1787383281.936669:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979583232 00000100:00100000:3.0:1787383281.938890:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787383281.938907:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.938984:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979583232:12345-0@lo:400:kworker.0 Request processed in 81us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.938991:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1787383281.944560:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383281.944571:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383281.944575:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383281.944632:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979583616:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.944649:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979583488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.945265:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.945298:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979583744:0@lo:400:kworker.0 00000100:00100000:3.0:1787383281.945309:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979583360:0@lo:400:kworker.0 00010000:00080000:3.0:1787383281.945335:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc2d711c00 x1874206979583872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383281.945346:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979583872:0@lo:400:kworker.0 00000040:00080000:2.0:1787383282.186407:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383282.444496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383282.444520:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979584000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383282.444587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383282.444862:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584000 00000100:00100000:0.0:1787383282.444898:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584000 00000100:00100000:0.0:1787383282.444947:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383282.444956:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979584000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383282.444991:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383282.445036:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979584000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383282.445043:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787383282.445193:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3c868e00 x1874206979584000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383282.445213:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979584000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383282.507065:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383282.954057:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979584128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383282.954149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383282.954225:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584128 00000100:00100000:0.0:1787383282.954233:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584128 00000100:00100000:0.0:1787383282.954294:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383282.954311:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979584128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383282.954349:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383282.954397:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979584128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383282.954404:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383282.954446:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979584128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787383283.530202:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383284.556058:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383284.688185:0:11708:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:21:23 (1787383283) 00000100:00100000:3.0:1787383285.232740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383285.232928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383285.232971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383285.233112:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771200 00000100:00100000:1.0:1787383285.233124:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771200 00000100:00100000:1.0:1787383285.233195:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771072 00000100:00100000:1.0:1787383285.233198:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771072 00000100:00100000:1.0:1787383285.233222:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1787383285.233240:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962771200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383285.233314:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962771200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383285.233322:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1787383285.233340:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:1.0:1787383285.233346:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962771072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383285.233373:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962771072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383285.233379:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00080000:3.0:1787383285.233683:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383285.234185:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962770944 00000100:00100000:0.0:1787383285.234193:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962770944 00000100:00100000:0.0:1787383285.234272:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 283 00000100:00100000:0.0:1787383285.234282:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962770944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383285.234345:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962770944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 64us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383285.234352:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 283 00010000:00010000:0.0:1787383285.578138:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383286.602235:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383286.679642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383286.679784:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771328 00000100:00100000:1.0:1787383286.679798:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771328 00000100:00100000:1.0:1787383286.679907:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1787383286.679917:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:10198:x1874206962771328:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383286.679937:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383286.679963:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ced0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b110 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680026:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680039:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680051:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383286.680235:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787383286.680244:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383286.680338:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680363:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ced0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b110 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680378:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b110 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.680386:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425900) 00010000:00010000:1.0:1787383286.680389:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383286.680393:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383286.680485:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:10198:x1874206962771328:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 569us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383286.680492:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1787383286.706007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383286.706079:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771456 00000100:00100000:3.0:1787383286.706088:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771456 00000100:00100000:3.0:1787383286.706140:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1787383286.706150:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:10199:x1874206962771456:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383286.706169:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383286.706188:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b117 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706245:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706258:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706269:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706281:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706287:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.706293:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707452:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707607:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707618:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383286.707843:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787383286.707848:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383286.707943:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707955:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707961:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707968:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707973:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383286.707977:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707984:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.707996:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425900) 00010000:00010000:3.0:1787383286.707999:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383286.708003:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708019:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708033:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708039:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708045:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708050:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383286.708054:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708060:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708068:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ffc094feb00) 00010000:00010000:3.0:1787383286.708071:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383286.708074:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708079:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708117:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b117 expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708131:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b117 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383286.708144:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc094fe000) 00010000:00010000:3.0:1787383286.708147:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383286.708150:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99e00, rc 0) 00000100:00100000:3.0:1787383286.709109:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:10199:x1874206962771456:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2954us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383286.709120:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1787383286.733314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383286.733391:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771712 00000100:00100000:1.0:1787383286.733400:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771712 00000100:00100000:1.0:1787383286.733466:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:1.0:1787383286.733477:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:10199:x1874206962771712:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383286.733497:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383286.733517:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ced34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b11e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733590:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733604:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733633:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733659:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733667:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.733673:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734231:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6aa00/0x42020b050d5ced49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734242:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6aa00/0x42020b050d5ced49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734250:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6aa00/0x42020b050d5ced49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383286.734259:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787383286.734456:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734464:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734471:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734477:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383286.734487:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734495:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734507:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc094fe000) 00010000:00010000:1.0:1787383286.734510:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383286.734514:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734520:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5ced3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734532:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734539:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734544:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734549:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383286.734552:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734558:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734564:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffc01425000) 00010000:00010000:1.0:1787383286.734567:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383286.734576:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.734582:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5ced42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.735021:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ced34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b11e expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.735036:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6aa00/0x42020b050d5ced49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b11e expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383286.735043:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:1.0:1787383286.735046:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383286.735048:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6aa00, rc 0) 00000100:00100000:1.0:1787383286.735121:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10199:x1874206962771712:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1646us (1816us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787383286.735130:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1787383286.748219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383286.748563:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771840 00000100:00100000:2.0:1787383286.748578:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771840 00000100:00100000:2.0:1787383286.748658:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1787383286.748670:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10199:x1874206962771840:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787383286.748802:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10199:x1874206962771840:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 135us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383286.748810:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1787383287.054051:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979584256:0@lo:400:kworker.0 00000100:00100000:2.0:1787383287.054209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383287.055849:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979584384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.055954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383287.056023:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584384 00000100:00100000:0.0:1787383287.056034:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584384 00000100:00100000:0.0:1787383287.056092:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787383287.056102:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.056165:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979584384:12345-0@lo:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.056173:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787383287.056231:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979584384:0@lo:400:kworker.0 00000100:00100000:2.0:1787383287.056340:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584256 00000100:00100000:2.0:1787383287.056345:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584256 00000100:00100000:2.0:1787383287.056396:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787383287.056404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979584256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383287.056447:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979584256:12345-0@lo:400:kworker.0 Request processed in 45us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383287.056454:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787383287.056496:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979584256:0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.060710:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979584768:0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.060812:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383287.060912:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979584896:0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.060942:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383287.060982:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584896 00000100:00100000:0.0:1787383287.060992:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584896 00000100:00100000:0.0:1787383287.061061:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787383287.061073:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979584896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383287.061132:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979584896:12345-0@lo:400:kworker.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.061153:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787383287.061179:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787383287.061219:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3cb5ca80 x1874206979584896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383287.061237:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979584896:0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061357:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979584512:0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383287.061419:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383287.061424:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979584640:0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383287.061478:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584768 00000100:00100000:1.0:1787383287.061483:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584768 00000100:00100000:1.0:1787383287.061515:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584512 00000100:00100000:1.0:1787383287.061519:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584512 00000100:00100000:1.0:1787383287.061541:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787383287.061548:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061595:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979584768:12345-0@lo:400:kworker.0 Request processed in 48us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383287.061603:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787383287.061617:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787383287.061622:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979584512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061651:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979584512:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383287.061656:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787383287.061674:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979584640 00000100:00100000:1.0:1787383287.061677:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979584640 00000100:00100000:1.0:1787383287.061702:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383287.061708:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979584640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061739:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979584640:12345-0@lo:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383287.061745:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383287.061787:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979584640:0@lo:400:kworker.0 00000100:00100000:1.0:1787383287.061797:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979584512:0@lo:400:kworker.0 00000100:00080000:1.0:1787383287.061814:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383287.061819:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383287.061832:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979584768:0@lo:400:kworker.0 00000040:00080000:0.0:1787383287.310950:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383287.567666:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979585024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383287.567773:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383287.567851:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979585024 00000100:00100000:1.0:1787383287.567861:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979585024 00000100:00100000:1.0:1787383287.567940:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383287.567962:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979585024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383287.568174:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383287.568287:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979585024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 326us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383287.568295:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787383287.568349:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc34c46a00 x1874206979585024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383287.568371:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979585024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383287.626598:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383288.076166:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383288.076262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383288.076491:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979585152 00000100:00100000:0.0:1787383288.076501:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979585152 00000100:00100000:0.0:1787383288.076579:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383288.076592:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979585152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383288.076638:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383288.076693:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979585152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383288.076701:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383288.076912:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383288.588666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383288.588767:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962771968 00000100:00100000:1.0:1787383288.588781:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962771968 00000100:00100000:1.0:1787383288.588902:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1787383288.588916:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10242:x1874206962771968:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383288.588943:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383288.588969:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5ced57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b125 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589053:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589070:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589086:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589102:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589127:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589135:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589445:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589455:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589462:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589469:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383288.589475:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589483:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589497:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425900) 00010000:00010000:1.0:1787383288.589500:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383288.589505:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589513:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5ced5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589528:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589545:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589552:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589557:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ac00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383288.589560:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589567:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589576:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffc01425000) 00010000:00010000:1.0:1787383288.589579:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383288.589581:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589588:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589628:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5ced57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b125 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589639:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425900) 00010000:00010000:1.0:1787383288.589641:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383288.589644:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5ced57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b125 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.589653:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a200, rc 0) 00000100:00100000:1.0:1787383288.589757:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10242:x1874206962771968:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 832us (1093us total) trans 0 rc 301/301 00000100:00100000:1.0:1787383288.589767:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00080000:2.0:1787383288.590223:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383288.595000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383288.595134:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772224 00000100:00100000:0.0:1787383288.595148:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772224 00000100:00100000:0.0:1787383288.595211:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1787383288.595223:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10242:x1874206962772224:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:0.0:1787383288.595480:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383288.595517:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5ced11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b110 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.595551:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425900) 00010000:00010000:0.0:1787383288.595566:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383288.595940:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.595964:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.595976:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.595990:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.595997:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.596003:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383288.598024:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787383288.598048:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598059:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598067:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598073:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383288.598079:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598086:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598118:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc0a060f00) 00010000:00010000:0.0:1787383288.598121:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383288.598126:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.598133:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5ced6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383288.598158:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b55a7adf reply state 000000007097c3f9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383288.598168:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383288.598709:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:10242:x1874206962772224:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 3479us (3712us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787383288.598720:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00010000:00010000:2.0:1787383288.608019:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608044:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608053:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608060:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383288.608066:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608074:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608095:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffc0a060a00) 00010000:00010000:2.0:1787383288.608099:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383288.608106:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383288.608113:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ced73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.656660:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383288.696777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383288.696951:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772352 00000100:00100000:1.0:1787383288.696965:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772352 00000100:00100000:1.0:1787383288.697107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1787383288.697122:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:10250:x1874206962772352:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:1.0:1787383288.697158:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383288.697189:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5ced7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b12c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697287:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697304:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697327:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383288.697414:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787383288.697418:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383288.697470:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697500:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5ced7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b12c expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697524:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b12c expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383288.697554:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:1.0:1787383288.697558:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383288.697562:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ac00, rc 0) 00000100:00100000:1.0:1787383288.697641:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:10250:x1874206962772352:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 523us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383288.697649:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1787383288.754489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.754574:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772480 00000100:00100000:3.0:1787383288.754585:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772480 00000100:00100000:3.0:1787383288.754650:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1787383288.754660:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:10256:x1874206962772480:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383288.754680:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383288.754700:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b133 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.754771:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.754786:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.754797:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755205:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755214:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755221:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755348:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755357:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755365:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383288.755399:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787383288.755403:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383288.755439:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755452:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755458:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755466:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755482:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383288.755487:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755494:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755508:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:3.0:1787383288.755511:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383288.755515:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755521:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ced8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755535:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755541:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755548:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755553:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383288.755556:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755562:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755580:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffc094feb00) 00010000:00010000:3.0:1787383288.755583:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383288.755586:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755592:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ced96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755635:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ced88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b133 expref: 12 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755650:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b133 expref: 11 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.755658:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383288.755661:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383288.755663:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99000, rc 0) 00000100:00100000:3.0:1787383288.755862:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:10256:x1874206962772480:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1201us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383288.755921:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1787383288.761554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.761696:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772736 00000100:00100000:3.0:1787383288.761705:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772736 00000100:00100000:3.0:1787383288.761808:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:3.0:1787383288.761819:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:10256:x1874206962772736:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383288.761841:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383288.761861:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ceda4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b13a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762149:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762163:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762175:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762233:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762241:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.762248:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383288.763218:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787383288.763464:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763477:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763486:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763519:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763538:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763545:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763551:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383288.763556:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763564:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763576:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383288.763579:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383288.763584:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763590:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cedab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383288.763615:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2171ece reply state 000000003000fbf4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383288.763625:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787383288.763661:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ceda4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763677:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.763696:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:3.0:1787383288.763699:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383288.763702:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99600, rc 0) 00000100:00100000:3.0:1787383288.763849:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10256:x1874206962772736:12345-192.168.202.19@tcp:101:bash.0 Request processed in 2031us (2303us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787383288.763858:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00010000:00010000:3.0:1787383288.768776:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768795:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768803:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768809:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383288.768814:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768822:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768839:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc094feb00) 00010000:00010000:3.0:1787383288.768842:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383288.768846:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.768853:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cedb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383288.774850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383288.775010:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772864 00000100:00100000:2.0:1787383288.775031:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772864 00000100:00100000:2.0:1787383288.775075:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1787383288.775084:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1874206962772864:12345-192.168.202.19@tcp:8:bash.0 00010000:00080000:2.0:1787383288.775116:0:6601:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:2.0:1787383288.775146:0:6601:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cedc7 00002000:00100000:2.0:1787383288.775159:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5843774-e16e-46d1-9ea7-9bdf9153dca9/ffff9ffc3dc72000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383288.775171:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383288.775715:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383288.775759:0:6601:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc77000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383288.775911:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962772864:12345-192.168.202.19@tcp:8:bash.0 Request processed in 825us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383288.775921:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1787383288.780194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383288.780302:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962772992 00000100:00100000:0.0:1787383288.780313:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962772992 00000100:00100000:0.0:1787383288.780554:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1787383288.780565:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:0:x1874206962772992:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383288.780585:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383288.780621:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b141 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383288.780649:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787383288.780685:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:0.0:1787383288.780690:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383288.780700:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.780720:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.780735:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047000, rc 0) 00000100:00100000:0.0:1787383288.780808:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:0:x1874206962772992:12345-192.168.202.19@tcp:101:bash.0 Request processed in 244us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383288.780815:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:2.0:1787383288.782533:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383288.791415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.791979:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962773120 00000100:00100000:3.0:1787383288.791990:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962773120 00000100:00100000:3.0:1787383288.792057:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1787383288.792068:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:10256:x1874206962773120:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383288.792087:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383288.792108:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b148 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.792159:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.792169:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787383288.792174:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383288.792179:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.792213:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.792227:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383288.792240:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874206979585280:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383288.792354:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383288.797523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.797696:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874206979585280:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383288.797762:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.797786:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98e00, rc 0) 00000100:00100000:3.0:1787383288.797856:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:10256:x1874206962773120:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5790us (6450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383288.797902:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1787383288.798158:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962773248 00000100:00100000:0.0:1787383288.798165:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962773248 00010000:00010000:0.0:1787383288.798194:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383288.798228:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1787383288.798237:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962773248:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383288.798249:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383288.798272:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.798284:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.798332:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815b8109/0x42020b050d5cedce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b141 expref: 8 pid: 6600 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.798345:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383288.798350:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383288.798358:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.798368:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383288.798400:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383288.798415:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1874206979585408:192.168.202.19@tcp:105: 00000100:00100000:0.0:1787383288.798464:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383288.804236:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1874206979585408:192.168.202.19@tcp:105: 00010000:00010000:0.0:1787383288.804285:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383288.804650:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962773248:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 6411us (7133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383288.804663:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1787383288.810864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.813422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962773504 00000100:00100000:3.0:1787383288.813441:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962773504 00000100:00100000:3.0:1787383288.813958:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383288.813981:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10256:x1874206962773504:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1787383288.816595:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10256:x1874206962773504:12345-192.168.202.19@tcp:35:bash.0 Request processed in 2604us (5729us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787383288.816755:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1787383288.931031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383288.933261:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962773760 00000100:00100000:3.0:1787383288.933282:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962773760 00000100:00100000:3.0:1787383288.933367:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1787383288.933380:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10266:x1874206962773760:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383288.933413:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383288.933441:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ceddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b14f expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383288.933610:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787383288.933781:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ceddc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b14f expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.933824:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:3.0:1787383288.933828:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383288.933833:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5ceddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b14f expref: 16 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383288.933849:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:2.0:1787383288.935403:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10266:x1874206962773760:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2013us (4376us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787383288.935417:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1787383288.943117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383288.943233:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774016 00000100:00100000:1.0:1787383288.943247:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774016 00000100:00100000:1.0:1787383288.943321:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1787383288.943334:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10266:x1874206962774016:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1787383288.943711:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10266:x1874206962774016:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 377us (607us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787383288.943721:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1787383289.060190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.060402:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774144 00000100:00100000:2.0:1787383289.060417:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774144 00000100:00100000:2.0:1787383289.060504:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1787383289.060517:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10272:x1874206962774144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383289.060552:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383289.060579:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cedea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b156 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060699:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060716:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060733:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383289.060824:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787383289.060829:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383289.060860:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060944:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cedea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b156 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060978:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b156 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.060987:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383289.060990:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383289.060995:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383289.061076:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10272:x1874206962774144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 562us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383289.061084:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1787383289.074969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383289.075058:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774400 00000100:00100000:1.0:1787383289.075072:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774400 00000100:00100000:1.0:1787383289.075158:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1787383289.075170:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10272:x1874206962774400:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383289.075199:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383289.075229:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cedf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b15d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.075422:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cedff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.075440:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.075466:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383289.075480:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787383289.075656:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cedf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b15d expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.075680:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cedff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b15d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.075691:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:1.0:1787383289.075695:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383289.075699:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b800, rc 0) 00000100:00100000:1.0:1787383289.075794:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10272:x1874206962774400:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 625us (839us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787383289.075802:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1787383289.080563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.080668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383289.080771:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774528 00000100:00100000:1.0:1787383289.080787:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774528 00000100:00100000:1.0:1787383289.080899:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1787383289.080911:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962774528:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383289.080932:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383289.080981:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cedff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b15d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.081005:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:1.0:1787383289.081012:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383289.081162:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774784 00000100:00100000:3.0:1787383289.081168:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774784 00000100:00100000:3.0:1787383289.081205:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1787383289.081213:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10272:x1874206962774784:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383289.081242:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383289.081261:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cee0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b164 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.081395:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.081412:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.081425:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383289.081441:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787383289.081974:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:2349:x1874206962774528:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 1059us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383289.081985:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00010000:00010000:3.0:1787383289.082676:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cee0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b164 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.082704:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b164 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.082730:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:3.0:1787383289.082733:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787383289.082737:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383289.082809:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10272:x1874206962774784:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1596us (2140us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787383289.082818:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1787383289.095101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.095203:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962774912 00000100:00100000:3.0:1787383289.095217:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962774912 00000100:00100000:3.0:1787383289.095289:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1787383289.095302:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2350:x1874206962774912:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:3.0:1787383289.095426:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.095464:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.095474:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383289.095478:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383289.095484:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.095642:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.095660:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 7 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383289.095699:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979585536:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383289.095941:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383289.099738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.099853:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775040 00000100:00100000:0.0:1787383289.099899:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775040 00000100:00100000:3.0:1787383289.099917:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979585536:192.168.202.19@tcp:104: 00002000:00100000:0.0:1787383289.099969:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ffc3cffd500 x1874206962775040/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:75/0 lens 504/0 e 0 to 0 dl 1787383300 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383289.099983:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc3cffd500 with x1874206962775040 ext(0->12) 00010000:00010000:0.0:1787383289.099993:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 8 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.100014:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 8 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383289.100023:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc3cffd500 00010000:00010000:3.0:1787383289.100026:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383289.100066:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1787383289.100079:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962775040:12345-192.168.202.19@tcp:4:lfs.0 00000001:00100000:2.0:1787383289.168584:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000100:00100000:1.0:1787383289.169637:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2348:x1874206962775040:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 69553us (69908us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787383289.169655:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:1.0:1787383289.169669:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ffc3cffd500 x1874206962775040/t4294967299(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:75/0 lens 504/448 e 0 to 0 dl 1787383300 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383289.169680:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc3cffd500 with x1874206962775040 ext(0->12) 00010000:00010000:1.0:1787383289.169690:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.169708:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383289.169717:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc3cffd500 00000100:00100000:1.0:1787383289.172708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.174199:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775168 00000100:00100000:3.0:1787383289.174216:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775168 00010000:00010000:3.0:1787383289.174263:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383289.174317:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:3.0:1787383289.174326:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2348:x1874206962775168:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383289.174341:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787383289.174361:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787383289.174364:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787383289 00002000:00010000:3.0:1787383289.174366:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787383289 00002000:00010000:3.0:1787383289.174368:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787383289 00010000:00010000:3.0:1787383289.174374:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.174388:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.174426:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1f36212/0x42020b050d5cedd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b148 expref: 9 pid: 6599 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.174441:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383289.174445:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383289.174451:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.174460:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.174618:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383289.174678:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962775168:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 352us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383289.174685:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00010000:00010000:2.0:1787383289.175295:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175362:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175391:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175401:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175410:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175417:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383289.175422:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175432:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175450:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.175458:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bf83643/0x42020b050d5cee22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383289.175577:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2350:x1874206962774912:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 80277us (80490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383289.175586:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1787383289.178402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.178535:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775424 00000100:00100000:3.0:1787383289.178545:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775424 00000100:00100000:3.0:1787383289.178608:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1787383289.178618:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10272:x1874206962775424:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:3.0:1787383289.178681:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b164 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383289.178994:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787383289.179052:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787383289.179733:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787383289.179805:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.179828:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.179838:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.179905:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.179920:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 24 pid: 5805 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383289.179934:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979585664:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383289.180030:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383289.184363:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979585664:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383289.184405:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383289.189291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.189433:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775552 00000100:00100000:0.0:1787383289.189443:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775552 00010000:00010000:0.0:1787383289.189481:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 25 pid: 5805 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383289.189519:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1787383289.189529:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:2348:x1874206962775552:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383289.189543:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383289.189549:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 25 pid: 5805 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189580:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 25 pid: 5805 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189604:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cedb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b13a expref: 25 pid: 5805 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189621:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:0.0:1787383289.189626:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189636:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189644:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.189668:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383289.189721:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:2348:x1874206962775552:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 193us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383289.189729:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00010000:00010000:3.0:1787383289.189991:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.190000:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383289.190124:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787383289.194125:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787383289.194331:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979585792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383289.194412:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383289.194494:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383289.195008:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979585792 00000100:00100000:1.0:1787383289.195018:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979585792 00000100:00100000:1.0:1787383289.195083:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383289.195099:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979585792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787383289.195194:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979585792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383289.195202:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787383289.195287:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383289.197094:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979585792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787383289.199403:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787383289.199495:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979585920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383289.199563:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383289.199643:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383289.201053:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979585920 00000100:00100000:0.0:1787383289.201065:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979585920 00000100:00100000:0.0:1787383289.201119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383289.201128:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979585920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787383289.201505:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1874206979585920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 375us (1939us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787383289.201513:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383289.201618:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979585920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787383289.201685:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787383289.201723:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201732:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201749:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201754:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383289.201758:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201765:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201779:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:3.0:1787383289.201782:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787383289.201785:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.201800:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cee29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383289.202003:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787383289.202214:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787383289.202228:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313416359560ns, next at 314416357503ns, rc = 0 00000001:00080000:3.0:1787383289.202234:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787383289.202265:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fe500) 00010000:00010000:3.0:1787383289.202268:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787383289.202275:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cee14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b164 expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383289.202423:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:10272:x1874206962775424:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 23806us (24031us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787383289.202431:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000020:00080000:3.0:1787383289.202435:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787383289.208458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.208561:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775680 00000100:00100000:0.0:1787383289.208571:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775680 00000100:00100000:0.0:1787383289.208631:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1787383289.208641:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:10272:x1874206962775680:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383289.208665:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383289.208688:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cee30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b16b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.208757:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cee30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b16b expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.208773:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cee30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b16b expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.208793:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383289.208796:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383289.208800:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046400, rc 0) 00000100:00100000:0.0:1787383289.208862:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:10272:x1874206962775680:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 223us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383289.208901:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1787383289.214485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.214582:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962775936 00000100:00100000:3.0:1787383289.214592:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962775936 00000100:00100000:3.0:1787383289.214655:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1787383289.214665:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:10272:x1874206962775936:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383289.214922:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10272:x1874206962775936:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 258us (446us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787383289.214931:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383289.314971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.315073:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962776192 00000100:00100000:0.0:1787383289.315083:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962776192 00000100:00100000:0.0:1787383289.315190:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1787383289.315204:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10282:x1874206962776192:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383289.315231:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383289.315253:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cee37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b172 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383289.315402:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787383289.315520:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cee37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b172 expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.315536:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:0.0:1787383289.315539:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383289.315545:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cee37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b172 expref: 31 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.315559:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383289.315628:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10282:x1874206962776192:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 427us (665us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787383289.315634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1787383289.319616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.322839:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962776320 00000100:00100000:2.0:1787383289.322853:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962776320 00000100:00100000:2.0:1787383289.322945:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:2.0:1787383289.322955:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10282:x1874206962776320:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1787383289.323033:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323049:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323061:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323417:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323427:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323435:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323538:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323563:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323571:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383289.323614:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323627:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323635:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323642:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323649:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.323654:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323662:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323673:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383289.323677:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383289.323681:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323688:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323707:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323714:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323720:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323726:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.323729:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323735:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323755:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5500) 00010000:00010000:2.0:1787383289.323757:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383289.323760:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323766:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323780:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323786:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323792:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323802:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.323805:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323811:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323819:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383289.323822:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383289.323825:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.323831:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383289.323995:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10282:x1874206962776320:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1039us (4387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383289.324004:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1787383289.331764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.332352:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962776576 00000100:00100000:0.0:1787383289.332363:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962776576 00000100:00100000:0.0:1787383289.332431:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1787383289.332443:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10282:x1874206962776576:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383289.332853:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:10282:x1874206962776576:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 411us (1097us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787383289.332861:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383289.400566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.400726:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962776832 00000100:00100000:2.0:1787383289.400764:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962776832 00000100:00100000:2.0:1787383289.400827:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1787383289.400837:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:10285:x1874206962776832:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383289.400861:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383289.400914:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b179 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.400994:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401028:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401039:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401054:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401061:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401068:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401198:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401206:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401214:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383289.401224:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787383289.401335:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401343:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401350:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401362:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.401367:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401375:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401388:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383289.401391:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383289.401396:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401402:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cee61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401417:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401423:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401428:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401433:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.401436:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401442:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401461:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5500) 00010000:00010000:2.0:1787383289.401463:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383289.401466:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401472:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401515:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401529:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 33 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.401536:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383289.401539:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383289.401541:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514400, rc 0) 00000100:00100000:2.0:1787383289.401666:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10285:x1874206962776832:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 829us (1109us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787383289.401673:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1787383289.405938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.406133:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962776960 00000100:00100000:2.0:1787383289.406143:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962776960 00000100:00100000:2.0:1787383289.406199:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1787383289.406208:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10285:x1874206962776960:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1787383289.406272:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406288:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406308:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406334:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406340:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406346:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406352:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383289.406357:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406364:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406376:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383289.406379:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383289.406382:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.406387:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383289.406643:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10285:x1874206962776960:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 434us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383289.406650:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1787383289.419169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.419262:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962777216 00000100:00100000:3.0:1787383289.419273:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962777216 00000100:00100000:3.0:1787383289.419389:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1787383289.419413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10285:x1874206962777216:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383289.419663:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:10285:x1874206962777216:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 252us (503us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787383289.419672:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00010000:00010000:0.0:1787383289.675691:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383289.804130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.804249:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962777472 00000100:00100000:2.0:1787383289.804283:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962777472 00000100:00100000:2.0:1787383289.804349:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1787383289.804361:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:10316:x1874206962777472:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383289.804385:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383289.804406:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b180 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.804499:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.804512:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.804525:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383289.804537:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787383289.804679:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cee84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b180 expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.804697:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b180 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.804705:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383289.804708:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383289.804712:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515000, rc 0) 00000100:00100000:2.0:1787383289.804788:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10316:x1874206962777472:12345-192.168.202.19@tcp:101:cat.0 Request processed in 429us (668us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787383289.804797:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1787383289.809929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.810029:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962777600 00000100:00100000:0.0:1787383289.810039:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962777600 00000100:00100000:0.0:1787383289.810106:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1787383289.810116:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:2349:x1874206962777600:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383289.810147:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383289.810172:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cee8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b180 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.810190:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383289.810195:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383289.810250:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:2349:x1874206962777600:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383289.810258:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1787383289.813599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383289.813781:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962777856 00000100:00100000:0.0:1787383289.813791:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962777856 00000100:00100000:0.0:1787383289.813855:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1787383289.813882:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:10316:x1874206962777856:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1787383289.814154:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10316:x1874206962777856:12345-192.168.202.19@tcp:35:cat.0 Request processed in 288us (563us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787383289.814162:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383289.882952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383289.883088:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962778112 00000100:00100000:1.0:1787383289.883100:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962778112 00000100:00100000:1.0:1787383289.883156:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1787383289.883165:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10322:x1874206962778112:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:1.0:1787383289.883189:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383289.883192:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383289.883218:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cedf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b156 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883237:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383289.883242:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383289.883255:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cee99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b187 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883370:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883399:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883407:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883437:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.883449:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 36 pid: 5803 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383289.883463:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979586048:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383289.883556:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383289.889903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383289.889999:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979586048:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383289.890026:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383289.890111:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962778240 00000100:00100000:0.0:1787383289.890118:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962778240 00010000:00010000:0.0:1787383289.890154:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 37 pid: 5803 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383289.890193:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1787383289.890203:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:2349:x1874206962778240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383289.890219:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383289.890226:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 37 pid: 5803 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890282:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 37 pid: 5803 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890311:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cee6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b179 expref: 37 pid: 5803 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890327:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383289.890332:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890341:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890350:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383289.890377:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383289.890436:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:2349:x1874206962778240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 234us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383289.890443:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00010000:00010000:3.0:1787383289.890501:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.890508:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383289.890528:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787383289.890692:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cee99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.890706:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383289.890713:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:3.0:1787383289.890716:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383289.890719:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6be00, rc 0) 00000100:00100000:3.0:1787383289.890756:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10322:x1874206962778112:12345-192.168.202.19@tcp:101:dd.0 Request processed in 7592us (7816us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787383289.890764:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1787383289.895065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383289.895189:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962778496 00000100:00100000:2.0:1787383289.895198:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962778496 00000100:00100000:2.0:1787383289.895252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1787383289.895263:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10322:x1874206962778496:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1787383289.895551:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.895569:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383289.895581:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383289.895633:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787383289.895659:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026f86b95 reply state 00000000a42f99f7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383289.895669:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383289.895769:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:10322:x1874206962778496:12345-192.168.202.19@tcp:36:dd.0 Request processed in 506us (711us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787383289.895777:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000020:00080000:2.0:1787383289.895782:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787383289.907249:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907269:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907278:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907284:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383289.907290:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907298:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907344:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:1.0:1787383289.907348:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383289.907352:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383289.907359:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5ceeae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383290.346433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383290.346557:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962778624 00000100:00100000:2.0:1787383290.346572:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962778624 00000100:00100000:2.0:1787383290.346677:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1787383290.346696:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:10336:x1874206962778624:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1787383290.346724:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383290.346755:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5ceeb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b18e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346855:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346903:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346916:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346932:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346943:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.346949:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383290.347286:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383290.347430:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.347443:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.347452:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.347496:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.347522:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 39 pid: 5805 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383290.347537:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979586176:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383290.347632:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383290.350402:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979586176:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383290.350448:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383290.350812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383290.350918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962778880 00000100:00100000:3.0:1787383290.350929:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962778880 00000100:00100000:3.0:1787383290.351004:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383290.351017:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:5560:x1874206962778880:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787383290.351658:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:5560:x1874206962778880:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 640us (846us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787383290.351668:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383290.352863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383290.353022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383290.353111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383290.357410:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779008 00000100:00100000:0.0:1787383290.357434:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779008 00000100:00100000:0.0:1787383290.357543:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 285 00000100:00100000:0.0:1787383290.357556:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962779008:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383290.357698:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962779008:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 143us (4674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383290.357707:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 285 00000100:00100000:2.0:1787383290.359302:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779264 00000100:00100000:2.0:1787383290.359331:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779264 00000100:00100000:2.0:1787383290.359424:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:2.0:1787383290.359435:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962779264:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383290.359526:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2350:x1874206962779264:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 92us (6422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.359534:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00080000:2.0:1787383290.359592:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383290.362028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383290.362695:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779392 00000100:00100000:0.0:1787383290.362712:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779392 00010000:00010000:0.0:1787383290.362790:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 41 pid: 5805 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383290.362847:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1787383290.362859:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:2349:x1874206962779392:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383290.362937:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383290.362947:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 41 pid: 5805 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.362962:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 41 pid: 5805 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.362992:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5ceea0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b187 expref: 41 pid: 5805 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.363014:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383290.363020:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.363033:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.363042:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.363819:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383290.363961:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:2349:x1874206962779392:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 1100us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383290.363973:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1787383290.364631:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779136 00000100:00100000:1.0:1787383290.364644:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779136 00000100:00100000:1.0:1787383290.364759:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1787383290.364772:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2350:x1874206962779136:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383290.364848:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2350:x1874206962779136:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (11993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383290.364856:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00080000:3.0:1787383290.365035:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787383290.369590:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.369614:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383290.369690:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787383290.369695:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383290.371211:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371244:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371257:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371265:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371273:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371280:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383290.371285:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371294:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371524:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383290.371529:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383290.371535:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371543:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5ceebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371563:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371570:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371592:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371598:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383290.371601:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371608:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371618:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5500) 00010000:00010000:2.0:1787383290.371620:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383290.371624:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371630:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5ceec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371686:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5ceeb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b18e expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371701:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b18e expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383290.371709:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383290.371712:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383290.371715:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514000, rc 0) 00000100:00100000:2.0:1787383290.371938:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:10336:x1874206962778624:12345-192.168.202.19@tcp:101:stat.0 Request processed in 25243us (25521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.371959:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1787383290.547577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383290.547630:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779648 00000100:00100000:0.0:1787383290.547642:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779648 00000100:00100000:0.0:1787383290.547722:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1787383290.547748:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:10342:x1874206962779648:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:0.0:1787383290.548190:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383290.548230:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5ceeca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b18e expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.548256:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383290.548262:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383290.548640:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.548657:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.548667:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383290.548724:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787383290.548765:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2524067 reply state 00000000c9027e3a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383290.548791:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383290.550217:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:10342:x1874206962779648:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 2458us (2639us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787383290.550233:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000020:00080000:0.0:1787383290.550241:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383290.560170:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560193:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560203:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560210:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383290.560216:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560225:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560248:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383290.560252:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383290.560257:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.560264:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5ceed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383290.698185:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383290.784302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383290.784741:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962779776 00000100:00100000:3.0:1787383290.784756:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962779776 00000100:00100000:3.0:1787383290.784836:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:3.0:1787383290.784850:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:10356:x1874206962779776:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:3.0:1787383290.784946:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383290.784978:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b195 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785066:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785082:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785093:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785107:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785128:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785134:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785243:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785251:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785258:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383290.785433:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787383290.785438:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383290.785462:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785474:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785482:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785489:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785495:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785512:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383290.785517:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785525:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785537:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383290.785540:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383290.785544:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785550:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5ceedf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.785564:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787786:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787803:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787810:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383290.787815:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787824:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787863:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc094fe500) 00010000:00010000:3.0:1787383290.787866:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383290.787882:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787889:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5ceee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787948:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5ceed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 42 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787963:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 41 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383290.787972:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:3.0:1787383290.787974:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383290.787977:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383290.788056:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:10356:x1874206962779776:12345-192.168.202.19@tcp:101:stat.0 Request processed in 3207us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383290.788065:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1787383290.926347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383290.926492:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962780032 00000100:00100000:1.0:1787383290.926504:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962780032 00000100:00100000:1.0:1787383290.926580:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1787383290.926592:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:10366:x1874206962780032:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383290.926621:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383290.926649:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5ceef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b19c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383290.926835:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787383290.927038:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5ceef4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b19c expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383290.927082:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:1.0:1787383290.927085:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383290.927093:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5ceef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b19c expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383290.927113:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6bc00, rc 0) 00000100:00100000:1.0:1787383290.927210:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:10366:x1874206962780032:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 620us (878us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787383290.927220:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1787383290.935956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383290.936032:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962780288 00000100:00100000:1.0:1787383290.936057:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962780288 00000100:00100000:1.0:1787383290.936146:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1787383290.936157:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:10366:x1874206962780288:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1787383290.936527:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:10366:x1874206962780288:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 370us (583us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787383290.936536:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1787383291.003564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383291.009686:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962780544 00000100:00100000:0.0:1787383291.009702:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962780544 00000100:00100000:0.0:1787383291.009799:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1787383291.009811:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:10372:x1874206962780544:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383291.009838:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383291.009860:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cef02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.010004:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.010019:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.010027:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.010064:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.010076:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 44 pid: 8068 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383291.010089:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979586304:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383291.010229:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0cca3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383291.015429:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979586304:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383291.015461:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383291.016572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383291.016837:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962780672 00000100:00100000:0.0:1787383291.016847:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962780672 00010000:00010000:0.0:1787383291.016933:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 45 pid: 8068 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383291.016970:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1787383291.016981:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:2349:x1874206962780672:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383291.016996:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383291.017003:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 45 pid: 8068 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017017:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 45 pid: 8068 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017044:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5ceeed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b195 expref: 45 pid: 8068 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017062:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383291.017067:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017078:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017087:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.017124:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383291.017205:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:2349:x1874206962780672:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 225us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.017214:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00010000:00010000:2.0:1787383291.017564:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.017574:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383291.017593:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787383291.017764:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cef02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.017782:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.017791:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383291.017795:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383291.017798:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047000, rc 0) 00000100:00100000:2.0:1787383291.017843:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:10372:x1874206962780544:12345-192.168.202.19@tcp:101:bash.0 Request processed in 8036us (14289us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787383291.017852:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1787383291.020513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383291.020582:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962780928 00000100:00100000:1.0:1787383291.020592:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962780928 00000100:00100000:1.0:1787383291.020647:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:1.0:1787383291.020657:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:10372:x1874206962780928:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1787383291.020973:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.020990:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.021020:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383291.021074:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787383291.021097:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047ccc2fe reply state 000000005010916b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383291.021107:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383291.021203:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10372:x1874206962780928:12345-192.168.202.19@tcp:36:bash.0 Request processed in 546us (696us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787383291.021210:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000020:00080000:1.0:1787383291.021214:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787383291.025628:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025647:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025662:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025669:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383291.025675:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025683:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025703:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:1.0:1787383291.025706:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383291.025757:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.025764:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383291.034185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383291.034438:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962781056 00000100:00100000:3.0:1787383291.034448:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962781056 00000100:00100000:3.0:1787383291.034507:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1787383291.034518:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:10372:x1874206962781056:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383291.034550:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383291.034572:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cef1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1aa expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.034674:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.034688:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.034698:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.034742:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.034755:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 47 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383291.034770:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979586432:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383291.034862:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383291.037443:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979586432:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383291.037479:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383291.045221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383291.049498:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962781184 00000100:00100000:3.0:1787383291.049517:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962781184 00010000:00010000:3.0:1787383291.049571:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383291.049674:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1787383291.049685:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:2348:x1874206962781184:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383291.049701:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383291.049708:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049747:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049770:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cef09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1a3 expref: 48 pid: 5804 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049787:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:3.0:1787383291.049793:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049803:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049811:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383291.049853:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383291.049955:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:2348:x1874206962781184:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 271us (4743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383291.049963:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00010000:00010000:1.0:1787383291.050033:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.050042:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383291.050091:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787383291.050095:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383291.050115:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.050144:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cef1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1aa expref: 47 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.050158:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1aa expref: 46 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.050166:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:1.0:1787383291.050169:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383291.050172:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:1.0:1787383291.050197:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:10372:x1874206962781056:12345-192.168.202.19@tcp:101:bash.0 Request processed in 15682us (16023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383291.050205:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1787383291.057285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383291.057374:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962781440 00000100:00100000:1.0:1787383291.057383:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962781440 00000100:00100000:1.0:1787383291.057445:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1787383291.057455:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:10372:x1874206962781440:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1787383291.057709:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10372:x1874206962781440:12345-192.168.202.19@tcp:35:bash.0 Request processed in 255us (434us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787383291.057717:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1787383291.185397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.191201:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962781696 00000100:00100000:2.0:1787383291.191215:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962781696 00000100:00100000:2.0:1787383291.194808:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1787383291.194829:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10382:x1874206962781696:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383291.194858:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383291.194897:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1b1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383291.195122:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787383291.200064:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1b1 expref: 49 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.200086:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:2.0:1787383291.200089:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383291.200095:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1b1 expref: 49 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.200109:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383291.200183:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:10382:x1874206962781696:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5361us (14793us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787383291.200192:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1787383291.206643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.207356:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962781824 00000100:00100000:2.0:1787383291.207367:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962781824 00000100:00100000:2.0:1787383291.207425:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1787383291.207435:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:10382:x1874206962781824:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1787383291.207516:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207548:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207561:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207577:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207585:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207592:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207905:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207915:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207924:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383291.207965:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207977:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.207984:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208001:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208008:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.208012:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208020:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208032:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383291.208034:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383291.208039:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208045:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208057:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208063:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208069:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208074:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.208077:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208091:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208099:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5500) 00010000:00010000:2.0:1787383291.208101:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383291.208104:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208109:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208123:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208130:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208136:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208142:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.208145:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208151:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208157:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383291.208160:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383291.208162:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.208177:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383291.208263:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:10382:x1874206962781824:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 828us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383291.208270:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1787383291.218834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383291.219107:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962782080 00000100:00100000:1.0:1787383291.219125:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962782080 00000100:00100000:1.0:1787383291.219222:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383291.219239:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:10382:x1874206962782080:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1787383291.221024:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:10382:x1874206962782080:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 1774us (2185us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787383291.221041:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000001:00080000:3.0:1787383291.230842:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000001:00080000:3.0:1787383291.230968:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:3.0:1787383291.231022:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787383291.231060:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc27724840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787383291.231066:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b02600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc27724240 00000020:00080000:3.0:1787383291.231070:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b02800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc2cecc400 00000020:00080000:2.0:1787383291.231230:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1787383291.231244:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383291.231270:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979586560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787383291.231354:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383291.231441:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979586560 00000100:00100000:1.0:1787383291.231447:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979586560 00000100:00100000:1.0:1787383291.231507:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383291.231515:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874206979586560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787383291.231539:0:6601:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787383291.231570:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a894df9, atime: 0x6a894df9, ctime: 0x6a894df9, blocks: 0x1 00010000:00010000:1.0:1787383291.231578:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.231594:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1787383291.231598:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383291.231615:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.231631:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.231640:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.231647:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.231664:0:6601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787383291.232159:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1874206979586560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 643us (806us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787383291.232167:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787383291.232192:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787383291.232204:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383291.232210:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.232219:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383291.232224:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.232233:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.232261:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.232267:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cef4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.232285:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383291.232287:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383291.232289:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787383291.232320:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc0512ce00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787383291.232326:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979586560:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1787383291.232371:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787383291.281671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383291.281796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962782336 00000100:00100000:1.0:1787383291.281805:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962782336 00000100:00100000:1.0:1787383291.281859:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1787383291.281898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10385:x1874206962782336:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383291.281926:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383291.281949:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1b8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282022:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282035:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282046:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282078:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282083:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383291.282089:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283180:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283205:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283219:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383291.283235:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787383291.283375:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283384:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283392:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283398:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.283403:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283421:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283438:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383291.283442:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383291.283449:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283456:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cef5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283473:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283480:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283487:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283492:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ba00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.283495:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283501:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283510:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425700) 00010000:00010000:2.0:1787383291.283512:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383291.283515:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283532:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cef64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283598:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cef56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1b8 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283616:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1b8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.283625:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383291.283628:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383291.283631:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383291.284179:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10385:x1874206962782336:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2307us (2512us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787383291.284190:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1787383291.292285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.292410:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962782464 00000100:00100000:2.0:1787383291.292424:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962782464 00000100:00100000:2.0:1787383291.292509:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:2.0:1787383291.292522:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10385:x1874206962782464:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1787383291.292642:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292672:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292698:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292774:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292781:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292787:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292794:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383291.292799:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292807:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292822:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383291.292827:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383291.292832:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.292839:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383291.293002:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10385:x1874206962782464:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 481us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383291.293011:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1787383291.293987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383291.294078:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962782592 00000100:00100000:0.0:1787383291.294088:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962782592 00000100:00100000:0.0:1787383291.294152:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1787383291.294163:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:2349:x1874206962782592:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383291.294180:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383291.294208:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cef6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1b8 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.294229:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383291.294235:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383291.294290:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2349:x1874206962782592:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 129us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.294297:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1787383291.297354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.297469:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962782848 00000100:00100000:2.0:1787383291.297484:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962782848 00000100:00100000:2.0:1787383291.297559:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1787383291.297589:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10385:x1874206962782848:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383291.298009:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10385:x1874206962782848:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 420us (669us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787383291.298019:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1787383291.452861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.453089:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962783104 00000100:00100000:2.0:1787383291.453104:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962783104 00000100:00100000:2.0:1787383291.453185:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1787383291.453198:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10403:x1874206962783104:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383291.453233:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383291.453261:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1bf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.453424:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.453443:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.453458:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383291.453472:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787383291.453710:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1bf expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.453744:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1bf expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.453781:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:2.0:1787383291.453784:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787383291.453789:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383291.454061:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10403:x1874206962783104:12345-192.168.202.19@tcp:101:cat.0 Request processed in 864us (1213us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787383291.454071:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1787383291.519124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.519238:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962783232 00000100:00100000:2.0:1787383291.519248:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962783232 00000100:00100000:2.0:1787383291.519330:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1787383291.519396:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10404:x1874206962783232:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383291.519422:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383291.519444:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1c6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519515:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519529:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519540:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383291.519760:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787383291.519764:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383291.519829:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519863:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cef95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1c6 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519923:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1c6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.519932:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383291.519937:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383291.519942:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:0.0:1787383291.520103:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10404:x1874206962783232:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 752us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.520117:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:0.0:1787383291.530120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.530183:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962783616 00000100:00100000:2.0:1787383291.530193:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962783616 00000100:00100000:2.0:1787383291.530249:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1787383291.530260:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10404:x1874206962783616:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383291.530613:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10404:x1874206962783616:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 354us (500us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787383291.530622:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383291.536931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383291.537028:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962783744 00000100:00100000:0.0:1787383291.537054:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962783744 00000100:00100000:0.0:1787383291.537116:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1787383291.537126:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10404:x1874206962783744:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:0.0:1787383291.537142:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787383291.537178:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cef25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1aa expref: 19 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.537201:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cef87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1bf expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.537215:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cee30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b16b expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.537226:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc0a060500) 00010000:00010000:0.0:1787383291.537245:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383291.537612:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10404:x1874206962783744:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 486us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.537621:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1787383291.545006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383291.545131:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962783872 00000100:00100000:2.0:1787383291.545143:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962783872 00000100:00100000:2.0:1787383291.545206:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1787383291.545216:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10404:x1874206962783872:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:2.0:1787383291.545358:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.545375:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383291.545386:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383291.546057:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383291.546256:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787383291.546322:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787383291.546439:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10404:x1874206962783872:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1223us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383291.546448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1787383291.583100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383291.583194:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784000 00000100:00100000:0.0:1787383291.583204:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784000 00000100:00100000:0.0:1787383291.583267:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:0.0:1787383291.583287:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10406:x1874206962784000:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383291.583308:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383291.583328:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cefaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1cd expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583405:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583434:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583445:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583461:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583468:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583486:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583794:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583804:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583812:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383291.583847:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787383291.583851:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383291.583896:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583909:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583928:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583934:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583941:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583947:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383291.583951:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583960:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583972:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:0.0:1787383291.583975:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383291.583980:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583987:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cefb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.583998:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584004:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584010:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584021:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383291.584023:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584029:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584037:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc0a060500) 00010000:00010000:0.0:1787383291.584039:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383291.584041:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584047:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cefb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584079:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cefaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584093:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383291.584100:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:0.0:1787383291.584102:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383291.584105:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383291.584172:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10406:x1874206962784000:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 887us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.584180:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00010000:00010000:0.0:1787383291.727408:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383292.173092:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979586688:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173313:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173375:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979587200:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173403:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173431:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383292.173437:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979587072:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173462:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173569:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979586816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173611:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979587328:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173651:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383292.173656:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979586944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173676:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383292.173708:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979587200 00000100:00100000:2.0:1787383292.173727:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979587200 00000100:00100000:2.0:1787383292.173781:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979586816 00000100:00100000:2.0:1787383292.173784:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979586816 00000100:00100000:2.0:1787383292.173796:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979586944 00000100:00100000:2.0:1787383292.173798:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979586944 00000100:00100000:2.0:1787383292.173828:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787383292.173835:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979587200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.173952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979587200:12345-0@lo:400:kworker.0 Request processed in 116us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.173960:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383292.174073:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979586688 00000100:00100000:0.0:1787383292.174078:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979586688 00000100:00100000:0.0:1787383292.174103:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787383292.174109:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979586688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383292.174141:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979586688:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383292.174159:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787383292.174377:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787383292.174384:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979586816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174416:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979586816:12345-0@lo:400:kworker.0 Request processed in 33us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.174422:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787383292.174432:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787383292.174438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979586944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979586944:12345-0@lo:400:kworker.0 Request processed in 23us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.174476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787383292.174494:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979587072 00000100:00100000:2.0:1787383292.174497:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979587072 00000100:00100000:2.0:1787383292.174520:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979587328 00000100:00100000:2.0:1787383292.174523:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979587328 00000100:00100000:2.0:1787383292.174533:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383292.174538:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979587072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174562:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979587072:12345-0@lo:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.174567:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383292.174576:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787383292.174580:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979587328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174611:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979587328:12345-0@lo:400:kworker.0 Request processed in 30us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.174616:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787383292.174639:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383292.174643:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383292.174687:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979586944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174696:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979586816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174704:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979587328:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174749:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979587072:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174758:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979586688:0@lo:400:kworker.0 00000100:00100000:2.0:1787383292.174769:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979587200:0@lo:400:kworker.0 00000040:00080000:0.0:1787383292.427182:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383292.427194:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383292.427258:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787383292.427266:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383292.427415:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979587456:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383292.427516:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383292.432423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.432472:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784128 00000100:00100000:0.0:1787383292.432484:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784128 00000100:00100000:0.0:1787383292.432547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1787383292.432558:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962784128:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787383292.432643:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962784128:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383292.432651:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00080000:0.0:1787383292.432673:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383292.432858:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979587456:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383292.435195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.435276:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784256 00000100:00100000:0.0:1787383292.435285:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784256 00000100:00100000:0.0:1787383292.435336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1787383292.435344:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962784256:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383292.435373:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383292.435495:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962784256:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 150us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383292.435502:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:3.0:1787383292.444210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.445463:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784384 00000100:00100000:2.0:1787383292.445477:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784384 00000100:00100000:2.0:1787383292.445533:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1787383292.445543:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962784384:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787383292.445616:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445634:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445647:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445691:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445720:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445728:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445755:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445764:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445771:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383292.445818:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787383292.445823:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383292.445839:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445853:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445859:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445892:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445899:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383292.445903:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445917:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445931:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:2.0:1787383292.445934:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383292.445939:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445945:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cefc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445958:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445964:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445969:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445974:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383292.445977:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445982:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.445988:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ffc035c5d00) 00010000:00010000:2.0:1787383292.445990:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383292.445993:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446010:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cefcd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446027:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446033:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446039:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446044:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383292.446047:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446052:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446060:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383292.446062:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383292.446065:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.446071:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cefd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383292.446162:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962784384:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 619us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.446171:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1787383292.453029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.453108:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784640 00000100:00100000:3.0:1787383292.453119:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784640 00000100:00100000:3.0:1787383292.453177:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1787383292.453187:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962784640:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383292.453212:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383292.453244:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cefdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1d4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453366:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453382:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453396:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383292.453409:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787383292.453542:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453550:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453557:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453562:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383292.453567:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453575:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453587:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:3.0:1787383292.453591:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383292.453595:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453601:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cefe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453646:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cefdb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1d4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453656:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383292.453659:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383292.453663:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cefdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1d4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.453684:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99a00, rc 0) 00000100:00100000:3.0:1787383292.454012:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962784640:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 825us (992us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787383292.454020:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:1.0:1787383292.462676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.462796:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962784768 00000100:00100000:2.0:1787383292.462808:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962784768 00000100:00100000:2.0:1787383292.462987:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1787383292.462998:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962784768:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383292.463036:0:8068:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383292.463136:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962784768:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.463144:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1787383292.466265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.466359:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785024 00000100:00100000:0.0:1787383292.466371:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785024 00000100:00100000:0.0:1787383292.466436:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1787383292.466446:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962785024:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383292.466467:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383292.466471:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787383292.466501:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cef9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1c6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.466521:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:0.0:1787383292.466525:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383292.466538:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5ceff0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1db expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383292.467254:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787383292.467518:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5ceff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.467533:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5ceff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.467543:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5ceff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.467600:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5ceff0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1db expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.467628:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5ceff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1db expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.467635:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc0a060c00) 00010000:00010000:0.0:1787383292.467638:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383292.467641:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383292.467721:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10417:x1874206962785024:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1265us (1454us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787383292.467729:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:1.0:1787383292.472941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.473048:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785280 00000100:00100000:0.0:1787383292.473059:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785280 00000100:00100000:0.0:1787383292.473146:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:0.0:1787383292.473158:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10417:x1874206962785280:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383292.473219:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383292.473244:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5ceff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1db expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473259:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc0a060c00) 00010000:00010000:0.0:1787383292.473270:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383292.473293:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473306:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473315:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473371:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473381:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.473388:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474052:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474063:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474070:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474075:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383292.474079:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474087:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474098:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:0.0:1787383292.474101:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383292.474104:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474111:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf005 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474128:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474134:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474140:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474145:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383292.474148:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474154:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474162:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd038daec (ffff9ffc0a060700) 00010000:00010000:0.0:1787383292.474165:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383292.474167:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.474172:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf00c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd038daec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383292.474266:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962785280:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1109us (1333us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383292.474275:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1787383292.477964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.478011:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785408 00000100:00100000:1.0:1787383292.478023:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785408 00000100:00100000:1.0:1787383292.478142:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1787383292.478154:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10417:x1874206962785408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383292.478176:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383292.478199:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1e2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478411:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478425:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478437:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478539:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478554:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.478563:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383292.478567:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383292.478571:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6bc00, rc 0) 00000100:00100000:1.0:1787383292.478631:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10417:x1874206962785408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 479us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.478639:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1787383292.487334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.487407:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785664 00000100:00100000:1.0:1787383292.487416:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785664 00000100:00100000:1.0:1787383292.487475:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1787383292.487486:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10417:x1874206962785664:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383292.487570:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.487587:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.487601:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383292.488046:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787383292.488057:0:8068:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316702187574ns, next at 317702185312ns, rc = 0 00000004:00010000:1.0:1787383292.488165:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000366aeff2 reply state 0000000015e47f8c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.488175:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383292.488280:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10417:x1874206962785664:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 794us (954us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787383292.488288:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00010000:00010000:3.0:1787383292.495173:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495189:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495197:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495203:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383292.495208:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495337:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495356:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383292.495360:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787383292.495365:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.495372:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf021 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383292.496204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.496381:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785792 00000100:00100000:3.0:1787383292.496390:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785792 00000100:00100000:3.0:1787383292.496492:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1787383292.496504:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10417:x1874206962785792:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383292.496528:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383292.496546:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1e9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.496604:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.496617:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.496636:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383292.496639:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383292.496642:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383292.496718:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10417:x1874206962785792:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 207us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.496725:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1787383292.500415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.500529:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962785920 00000100:00100000:2.0:1787383292.500538:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962785920 00000100:00100000:2.0:1787383292.500584:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1787383292.500593:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1874206962785920:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787383292.500627:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:2.0:1787383292.500653:0:6600:0:(genops.c:1406:class_connect()) connect: client c5843774-e16e-46d1-9ea7-9bdf9153dca9, cookie 0x42020b050d5cf02f 00002000:00100000:2.0:1787383292.500663:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5843774-e16e-46d1-9ea7-9bdf9153dca9/ffff9ffc3e58c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383292.500683:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383292.500942:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383292.500969:0:6600:0:(import.c:65:import_set_state_nolock()) ffff9ffc3e58b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383292.501030:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2347:x1874206962785920:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 Request processed in 437us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.501039:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1787383292.504385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.506795:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962786048 00000100:00100000:1.0:1787383292.506812:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962786048 00000100:00100000:1.0:1787383292.506915:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1787383292.506925:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:0:x1874206962786048:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787383292.507623:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787383292.521852:0:11856:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383292.521863:0:11856:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383292.521923:0:11856:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787383292.521930:0:11856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787383292.534656:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787383292.534685:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000100:00100000:3.0:1787383292.534790:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:0:x1874206962786048:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 27861us (30408us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787383292.534801:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1787383292.544852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.544967:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962786304 00000100:00100000:3.0:1787383292.544978:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962786304 00000100:00100000:3.0:1787383292.545084:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1787383292.545094:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10417:x1874206962786304:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787383292.545345:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:10417:x1874206962786304:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 251us (498us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787383292.545354:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1787383292.549501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.549573:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962786560 00000100:00100000:3.0:1787383292.549582:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962786560 00000100:00100000:3.0:1787383292.549639:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1787383292.549649:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:10417:x1874206962786560:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787383292.549768:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:10417:x1874206962786560:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.549776:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1787383292.552002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.552090:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962786688 00000100:00100000:0.0:1787383292.552099:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962786688 00000100:00100000:0.0:1787383292.552158:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1787383292.552168:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:10417:x1874206962786688:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383292.552189:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383292.552209:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1f0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552291:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552307:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552318:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383292.552360:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383292.552380:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552406:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cf036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f0 expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552423:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f0 expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.552432:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:0.0:1787383292.552435:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787383292.552439:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383292.552510:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10417:x1874206962786688:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 343us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383292.552527:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:2.0:1787383292.572779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.573655:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962786816 00000100:00100000:1.0:1787383292.573666:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962786816 00000100:00100000:2.0:1787383292.573754:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1787383292.573766:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962786816:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383292.573785:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383292.573807:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1f7 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383292.573833:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894dfd, blocks: 0x1 00010000:00010000:2.0:1787383292.573851:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1787383292.573856:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383292.574116:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.574140:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.574155:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514e00, rc 0) 00000100:00100000:2.0:1787383292.574248:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962786816:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 484us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.574256:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1787383292.578191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.578259:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787072 00000100:00100000:2.0:1787383292.578270:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787072 00000100:00100000:2.0:1787383292.578329:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1787383292.578340:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10417:x1874206962787072:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383292.578449:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10417:x1874206962787072:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 110us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.578476:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1787383292.584106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.586426:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787200 00000100:00100000:3.0:1787383292.586441:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787200 00000100:00100000:3.0:1787383292.586497:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1787383292.586507:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:10417:x1874206962787200:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383292.586525:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383292.586543:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b1fe expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.586574:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.586583:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383292.586593:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383292.586600:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.586636:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.586649:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383292.586663:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34fcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979587584:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383292.586774:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383292.589673:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34fcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979587584:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383292.589718:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.589739:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99a00, rc 0) 00000100:00100000:3.0:1787383292.589836:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:10417:x1874206962787200:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 3329us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.589845:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1787383292.590575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.590670:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787328 00000100:00100000:1.0:1787383292.590678:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787328 00010000:00010000:1.0:1787383292.590722:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.590795:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1787383292.590806:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962787328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383292.590819:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383292.590849:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.590862:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.590952:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf044 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f7 expref: 7 pid: 6600 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.590968:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383292.590973:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383292.590981:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.590991:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.591029:0:8310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.591045:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8310:1874206979587712:192.168.202.19@tcp:105: 00000100:00100000:1.0:1787383292.591290:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383292.597251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.597383:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787456 00000100:00100000:3.0:1787383292.597393:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787456 00002000:00100000:3.0:1787383292.597442:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ffc2d21ce00 x1874206962787456/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:78/0 lens 504/0 e 0 to 0 dl 1787383303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787383292.597454:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21ce00 with x1874206962787456 ext(0->8) 00002000:00010000:3.0:1787383292.597471:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21ce00 00000100:00100000:3.0:1787383292.597511:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1787383292.597520:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962787456:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787383292.598186:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962787456:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 664us (942us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787383292.598196:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:3.0:1787383292.598205:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ffc2d21ce00 x1874206962787456/t4294967302(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:78/0 lens 504/448 e 0 to 0 dl 1787383303 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787383292.598214:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21ce00 with x1874206962787456 ext(0->8) 00002000:00010000:3.0:1787383292.598219:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21ce00 00000100:00100000:2.0:1787383292.598779:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8310:1874206979587712:192.168.202.19@tcp:105: 00010000:00010000:2.0:1787383292.598804:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383292.598830:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962787328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 8025us (8256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.598840:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:3.0:1787383292.602499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.602606:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787584 00000100:00100000:0.0:1787383292.602616:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787584 00000100:00100000:0.0:1787383292.602716:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1787383292.602727:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10417:x1874206962787584:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787383292.633627:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:2.0:1787383292.633636:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10417:x1874206962787584:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 30902us (31135us total) trans 0 rc 0/0 00000001:00080000:3.0:1787383292.633643:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1787383292.633648:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787383292.633648:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000020:00080000:3.0:1787383292.633674:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1787383292.633685:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787383292.633802:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787383292.633814:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787383292.633823:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383292.633840:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979587840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787383292.633917:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383292.634258:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979587840 00000100:00100000:3.0:1787383292.634266:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979587840 00000100:00100000:3.0:1787383292.634376:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383292.634386:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979587840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787383292.634533:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787383292.634536:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787383293 00002000:00010000:3.0:1787383292.634538:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787383292.634540:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787383293 -> 1787383293 00002000:00010000:3.0:1787383292.634541:0:6600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787383292.634669:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979587840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (752us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787383292.634686:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787383292.634724:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc2d218700/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787383292.634731:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979587840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787383292.636987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.637045:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787712 00000100:00100000:3.0:1787383292.637055:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787712 00000100:00100000:3.0:1787383292.637156:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383292.637168:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962787712:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787383292.681973:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979587968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383292.682047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383292.682331:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979587968 00000100:00100000:1.0:1787383292.682339:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979587968 00000100:00100000:1.0:1787383292.682428:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383292.682439:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979587968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383292.682476:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383292.682534:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979587968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.682541:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383292.682613:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979587968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383292.685683:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962787712:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 48506us (48694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.685697:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000001:00080000:0.0:1787383292.685765:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787383292.685777:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787383292.688097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.688195:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962787968 00000100:00100000:2.0:1787383292.688204:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962787968 00000100:00100000:2.0:1787383292.688261:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:2.0:1787383292.688280:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10417:x1874206962787968:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383292.688331:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383292.688354:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf03d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1f0 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.688379:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:2.0:1787383292.688383:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383292.688408:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.688418:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.688424:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383292.688671:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b48309cf reply state 0000000072804ec8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383292.688679:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383292.688774:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10417:x1874206962787968:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 504us (686us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787383292.688782:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00010000:00010000:1.0:1787383292.691198:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691216:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691225:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691229:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.691233:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691238:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691251:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383292.691253:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383292.691256:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.691260:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383292.692362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.692682:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788096 00000100:00100000:3.0:1787383292.692690:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788096 00000100:00100000:3.0:1787383292.692777:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1787383292.692789:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962788096:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787383292.693063:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787383292.693067:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787383293 -> 1787383291 00002000:00010000:3.0:1787383292.693069:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787383289 00002000:00010000:3.0:1787383292.693071:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787383293 -> 1787383291 00002000:00010000:3.0:1787383292.693073:0:6600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787383292.693142:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962788096:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 355us (784us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787383292.693150:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1787383292.697483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.697607:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788352 00000100:00100000:1.0:1787383292.697618:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788352 00000100:00100000:1.0:1787383292.697678:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1787383292.697689:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10417:x1874206962788352:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787383292.697773:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.697790:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.697801:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.697837:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.697851:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 13 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.697865:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979588096:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383292.697994:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383292.701448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383292.701525:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788480 00000100:00100000:0.0:1787383292.701534:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788480 00010000:00010000:0.0:1787383292.701567:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 14 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383292.701596:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1787383292.701602:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2348:x1874206962788480:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383292.701612:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383292.701617:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 14 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.701626:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 14 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.701643:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:0.0:1787383292.701658:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.701666:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.701672:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383292.701687:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383292.701855:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf01a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e2 expref: 14 pid: 5803 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.701893:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979588096:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383292.701917:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701933:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701943:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701975:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701982:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701988:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.701994:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.701998:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.702005:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.702014:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383292.702017:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787383292.702020:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.702026:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf059 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383292.702145:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2348:x1874206962788480:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 541us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383292.702153:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1787383292.702461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:10417:x1874206962788352:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 4772us (5000us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787383292.702478:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1787383292.710726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.714827:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788608 00000100:00100000:3.0:1787383292.714847:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788608 00000100:00100000:2.0:1787383292.715003:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1787383292.715015:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962788608:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787383292.715070:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.715092:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.715120:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383292.715124:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383292.715129:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.715168:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.715182:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 7 pid: 6599 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383292.715197:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979588224:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383292.715295:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383292.718556:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979588224:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383292.718590:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.719053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383292.719753:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788736 00000100:00100000:2.0:1787383292.719765:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788736 00010000:00010000:2.0:1787383292.719804:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 8 pid: 6599 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383292.719931:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:2.0:1787383292.719939:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962788736:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383292.719953:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383292.719976:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 8 pid: 6599 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.720005:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 8 pid: 6599 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.720028:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cf04b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1fe expref: 8 pid: 6599 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.720044:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383292.720048:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383292.720053:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.720061:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.720093:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383292.720147:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962788736:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 208us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383292.720155:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00010000:00010000:3.0:1787383292.720222:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720231:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720280:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720289:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720296:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720302:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383292.720307:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720315:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720328:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.720335:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b97d24e/0x42020b050d5cf060 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383292.720384:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962788608:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 5370us (9676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.720391:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1787383292.722799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.722997:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962788992 00000100:00100000:1.0:1787383292.723006:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962788992 00000100:00100000:1.0:1787383292.723087:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1787383292.723097:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:10417:x1874206962788992:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383292.723176:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723194:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723205:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723506:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723516:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723524:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723566:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.723578:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 13 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.723591:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979588352:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383292.723716:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383292.729372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383292.729503:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962789120 00000100:00100000:3.0:1787383292.729512:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962789120 00010000:00010000:3.0:1787383292.729553:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 14 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383292.729594:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1787383292.729605:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2349:x1874206962789120:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383292.729620:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383292.729627:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 14 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.729640:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 14 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.729662:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383292.729668:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.729677:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.729684:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.729703:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383292.729863:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1e9 expref: 14 pid: 5805 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.729902:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979588352:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383292.729922:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.729932:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.729937:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383292.730128:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787383292.730279:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787383292.730328:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787383292.730433:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979588480:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383292.730479:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383292.730508:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383292.730537:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979588480 00000100:00100000:1.0:1787383292.730541:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979588480 00000100:00100000:1.0:1787383292.730575:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383292.730583:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1874206979588480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383292.730647:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1874206979588480:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.730654:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383292.730689:0:5804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787383292.730694:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc2d218700, transno 4294967303 00000100:00100000:1.0:1787383292.730721:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979588480:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787383292.731187:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787383292.731239:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979588608:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383292.731276:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383292.731294:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383292.731471:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979588608 00000100:00100000:1.0:1787383292.731475:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979588608 00000100:00100000:1.0:1787383292.731501:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383292.731507:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1874206979588608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383292.731654:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1874206979588608:12345-0@lo:1000:mdt00_001.0 Request processed in 145us (375us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787383292.731662:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383292.731719:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979588608:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787383292.731748:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731757:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731774:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731780:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.731785:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731794:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731809:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383292.731812:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383292.731818:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731824:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf06e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731857:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731864:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731894:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731899:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.731902:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731918:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731927:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383292.731930:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383292.731933:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731938:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cefa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731959:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731972:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.731980:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.732006:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.732019:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.732031:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979588736:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383292.732127:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:2349:x1874206962789120:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2523us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.732137:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1787383292.739899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.744172:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962789248 00000100:00100000:1.0:1787383292.744186:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962789248 00010000:00010000:1.0:1787383292.744254:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.744302:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1787383292.744312:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:2348:x1874206962789248:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383292.744327:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383292.744335:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744348:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 17 pid: 8068 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744371:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383292.744376:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744385:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744392:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744412:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383292.744526:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:2348:x1874206962789248:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 215us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.744534:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1787383292.744599:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787383292.744629:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cefbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b1cd expref: 16 pid: 8068 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383292.744652:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979588736:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383292.744674:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744683:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744690:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744700:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744717:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744724:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744730:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.744735:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744742:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744750:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383292.744753:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383292.744756:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744770:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf075 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744780:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744785:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744791:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744796:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383292.744799:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744804:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744811:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383292.744812:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383292.744815:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.744820:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383292.745085:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383292.745089:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383292.745110:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787383292.745115:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383292.745188:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10417:x1874206962788992:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 22092us (22397us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787383292.745198:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000020:00080000:1.0:1787383292.745202:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:0.0:1787383292.747010:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383292.751196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383292.751268:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962789504 00000100:00100000:1.0:1787383292.751278:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962789504 00000100:00100000:1.0:1787383292.751344:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1787383292.751353:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10417:x1874206962789504:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787383292.752208:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787383292.752325:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787383292.752369:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752385:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752395:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752403:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752409:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752414:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383292.752651:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383292.752832:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10417:x1874206962789504:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1474us (1640us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787383292.752844:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000020:00080000:2.0:1787383292.752852:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787383292.755480:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383292.755508:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.755519:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383292.755524:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.755533:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.755553:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffc01425c00) 00010000:00010000:3.0:1787383292.755556:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383292.755561:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383292.755567:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf07c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383292.756376:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383292.756381:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383292.756383:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383293.198900:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979588864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383293.198999:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383293.199566:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979588864 00000100:00100000:3.0:1787383293.199576:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979588864 00000100:00100000:3.0:1787383293.199633:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787383293.199643:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874206979588864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383293.199670:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787383293.199736:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874206979588864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383293.199744:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787383293.199837:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979588864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787383293.786506:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787383294.294676:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1787383294.294707:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787383294.294715:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000040:00080000:2.0:1787383294.452154:0:11910:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383294.452165:0:11910:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787383294.452202:0:11910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787383294.452208:0:11910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383294.619645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.619686:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962789760 00000100:00100000:3.0:1787383294.619713:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962789760 00000100:00100000:3.0:1787383294.619779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1787383294.619790:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:10436:x1874206962789760:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383294.619815:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383294.619837:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b205 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.620142:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cf08a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.620157:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cf08a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.620172:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cf08a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383294.620186:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787383294.621521:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b205 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.621543:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cf08a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b205 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.621554:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383294.621557:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383294.621560:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99600, rc 0) 00000100:00100000:3.0:1787383294.621641:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10436:x1874206962789760:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1852us (2007us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787383294.621651:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00080000:3.0:1787383294.621698:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383294.627729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.630736:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962789888 00000100:00100000:3.0:1787383294.630756:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962789888 00000100:00100000:3.0:1787383294.630819:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1787383294.630832:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10436:x1874206962789888:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1787383294.630946:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.630968:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.630981:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.630997:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631005:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631013:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631634:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631646:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631654:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383294.631712:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631733:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631741:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631748:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631756:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.631761:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631769:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631784:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383294.631787:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.631793:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631800:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631814:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631820:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631827:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631839:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.631842:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631849:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631858:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc094fe500) 00010000:00010000:3.0:1787383294.631861:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.631864:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631897:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf09f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631913:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631920:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631926:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631931:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.631935:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631942:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631961:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc094fed00) 00010000:00010000:3.0:1787383294.631963:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.631966:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.631973:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383294.632055:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10436:x1874206962789888:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1222us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383294.632065:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:0.0:1787383294.693155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383294.693276:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962790144 00000100:00100000:1.0:1787383294.693288:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962790144 00000100:00100000:1.0:1787383294.693356:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1787383294.693367:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:10439:x1874206962790144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383294.693390:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383294.693411:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf0ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b20c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693490:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693505:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693518:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693535:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693542:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693548:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693969:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693979:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.693995:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383294.694006:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787383294.694104:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694111:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694116:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694122:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383294.694126:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694133:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694145:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383294.694148:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383294.694152:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694158:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf0b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694170:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694175:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694187:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694192:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383294.694195:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694201:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694208:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425600) 00010000:00010000:1.0:1787383294.694210:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383294.694213:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694218:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694260:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf0ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694275:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.694282:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383294.694284:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383294.694286:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ae00, rc 0) 00000100:00100000:1.0:1787383294.694347:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10439:x1874206962790144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 981us (1205us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787383294.694364:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1787383294.700211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383294.700548:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962790272 00000100:00100000:2.0:1787383294.700559:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962790272 00000100:00100000:2.0:1787383294.700657:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:2.0:1787383294.700668:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10439:x1874206962790272:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1787383294.700753:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700770:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700781:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700809:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700816:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700823:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700829:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383294.700846:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700854:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700903:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:2.0:1787383294.700907:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383294.700912:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.700919:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf0d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383294.700997:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10439:x1874206962790272:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 330us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383294.701005:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:0.0:1787383294.704026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.704169:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962790528 00000100:00100000:3.0:1787383294.704179:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962790528 00000100:00100000:3.0:1787383294.704515:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1787383294.704526:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10439:x1874206962790528:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383294.704791:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:10439:x1874206962790528:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 267us (775us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787383294.704799:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1787383294.758805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383294.758891:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962790784 00000100:00100000:1.0:1787383294.758902:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962790784 00000100:00100000:1.0:1787383294.758964:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:1.0:1787383294.758975:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:9960:x1874206962790784:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383294.758999:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383294.759020:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf0d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b213 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.759124:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.759139:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.759149:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.759209:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.759223:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 23 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383294.759237:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979588992:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383294.759346:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383294.765945:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979588992:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383294.765994:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383294.773215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.773994:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962790912 00000100:00100000:3.0:1787383294.774006:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962790912 00010000:00010000:3.0:1787383294.774054:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 24 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383294.774098:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1787383294.774108:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:2348:x1874206962790912:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383294.774124:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383294.774147:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 24 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774160:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 24 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774183:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf0c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b20c expref: 24 pid: 5805 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774211:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383294.774217:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774227:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774234:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.774383:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383294.774449:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:2348:x1874206962790912:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 342us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383294.774457:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00010000:00010000:1.0:1787383294.778122:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.778141:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383294.778169:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787383294.778727:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf0d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.778752:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383294.778761:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383294.778764:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383294.778767:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b400, rc 0) 00000100:00100000:1.0:1787383294.778969:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:9960:x1874206962790784:12345-192.168.202.19@tcp:101:bash.0 Request processed in 19995us (20173us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787383294.778979:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:0.0:1787383294.785544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.785712:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791168 00000100:00100000:3.0:1787383294.785723:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791168 00000100:00100000:3.0:1787383294.785842:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1787383294.785908:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:9960:x1874206962791168:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:3.0:1787383294.786247:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.786298:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.786311:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383294.786365:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787383294.786392:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019a616ca reply state 00000000d572040d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383294.786402:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787383294.786450:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787383294.786973:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:9960:x1874206962791168:12345-192.168.202.19@tcp:36:bash.0 Request processed in 704us (1020us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787383294.786984:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000020:00080000:3.0:1787383294.786990:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787383294.791046:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791064:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791072:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791077:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.791082:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791089:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791126:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383294.791129:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.791134:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.791140:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf0ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383294.791997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.792439:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791296 00000100:00100000:3.0:1787383294.792449:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791296 00000100:00100000:3.0:1787383294.792515:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:3.0:1787383294.792525:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:9960:x1874206962791296:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383294.792549:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383294.792585:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b21a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.792642:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b21a expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.792656:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b21a expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.792674:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383294.792677:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383294.792681:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383294.792753:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:9960:x1874206962791296:12345-192.168.202.19@tcp:101:bash.0 Request processed in 229us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383294.792760:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00010000:00010000:0.0:1787383294.795135:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383294.797598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.798587:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791424 00000100:00100000:3.0:1787383294.798599:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791424 00000100:00100000:3.0:1787383294.798672:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1787383294.798683:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:9960:x1874206962791424:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383294.798711:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383294.798734:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b221 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383294.798762:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a894dfb, atime: 0x6a894df9, ctime: 0x6a894dfb, blocks: 0xb 00010000:00010000:3.0:1787383294.798783:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1787383294.798788:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383294.798796:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.798814:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.798826:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:3.0:1787383294.798914:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:9960:x1874206962791424:12345-192.168.202.19@tcp:101:bash.0 Request processed in 234us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383294.798921:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00080000:0.0:1787383294.799729:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383294.802921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383294.803090:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791552 00000100:00100000:1.0:1787383294.803100:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791552 00002000:00010000:1.0:1787383294.803142:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787383294.803148:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21d500 with x1874206962791552 ext(0->18446744073709551615) 00002000:00010000:1.0:1787383294.803160:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21d500. 00000100:00100000:1.0:1787383294.803193:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1787383294.803212:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962791552:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:1.0:1787383294.803516:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787383294.803520:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787383291 -> 1787383295 00002000:00010000:1.0:1787383294.803522:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787383289 -> 1787383289 00002000:00010000:1.0:1787383294.803525:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787383291 -> 1787383295 00002000:00010000:1.0:1787383294.803527:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787383294.807088:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962791552:12345-192.168.202.19@tcp:10:bash.0 Request processed in 3864us (4164us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787383294.807104:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00010000:1.0:1787383294.807112:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787383294.807116:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21d500 with x1874206962791552 ext(0->18446744073709551615) 00002000:00010000:1.0:1787383294.807130:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21d500. 00000100:00100000:2.0:1787383294.909272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.909353:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791680 00000100:00100000:3.0:1787383294.909363:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791680 00000100:00100000:3.0:1787383294.909423:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1787383294.909434:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:10453:x1874206962791680:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1787383294.909508:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909538:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909549:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909577:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909584:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909591:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909952:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909962:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.909970:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383294.910018:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910031:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910037:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910054:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910060:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.910065:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910073:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910085:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383294.910088:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.910093:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910099:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910113:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910119:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910125:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910130:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.910133:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910149:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910158:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc094fea00) 00010000:00010000:3.0:1787383294.910161:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.910164:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910169:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910184:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910190:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910196:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910201:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383294.910204:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910210:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910216:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383294.910218:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383294.910221:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.910234:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf10f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383294.910302:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:10453:x1874206962791680:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 868us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383294.910310:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1787383294.982220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383294.983035:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962791936 00000100:00100000:2.0:1787383294.983049:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962791936 00000100:00100000:2.0:1787383294.983129:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:2.0:1787383294.983140:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:10456:x1874206962791936:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383294.983164:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383294.983188:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b228 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983274:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983291:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983317:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983334:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983341:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.983347:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.984490:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf12b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.984507:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.984515:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383294.984526:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787383294.985339:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985352:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985359:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985365:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383294.985380:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985389:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985954:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383294.985960:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383294.985967:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985976:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf11d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.985998:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986004:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986011:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986016:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383294.986019:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986025:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986035:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383294.986037:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383294.986051:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986057:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986125:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b228 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986141:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf12b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b228 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383294.986148:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:2.0:1787383294.986150:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383294.986152:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:2.0:1787383294.986314:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10456:x1874206962791936:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 3174us (4105us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787383294.986324:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:0.0:1787383294.999098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383294.999204:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962792064 00000100:00100000:3.0:1787383294.999216:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962792064 00000100:00100000:3.0:1787383294.999414:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:3.0:1787383294.999427:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10456:x1874206962792064:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1787383294.999505:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.999524:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.999535:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.999652:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383294.999668:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 29 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383294.999695:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34fce680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979589120:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383295.000309:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383295.004081:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34fce680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979589120:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383295.004113:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.004799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.005377:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962792320 00000100:00100000:2.0:1787383295.005386:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962792320 00000100:00100000:2.0:1787383295.005652:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1787383295.005664:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:5561:x1874206962792320:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787383295.007838:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:5561:x1874206962792320:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 2166us (3033us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787383295.007853:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1787383295.012779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.013368:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962792448 00000100:00100000:1.0:1787383295.013379:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962792448 00010000:00010000:1.0:1787383295.013435:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 31 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.013531:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1787383295.013541:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:2348:x1874206962792448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383295.013566:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383295.013573:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 31 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013587:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 31 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013608:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf0de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b213 expref: 31 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013632:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.013638:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013647:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013656:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.013697:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383295.013753:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:2348:x1874206962792448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 213us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.013762:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00010000:00010000:3.0:1787383295.013825:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013833:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013905:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013914:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013921:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013928:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383295.013932:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013940:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013950:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383295.013952:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383295.013956:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.013974:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.014014:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10456:x1874206962792064:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 14591us (14928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.014023:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:0.0:1787383295.028170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.028291:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962792704 00000100:00100000:3.0:1787383295.028301:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962792704 00000100:00100000:3.0:1787383295.028354:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1787383295.028365:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:10456:x1874206962792704:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383295.028632:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10456:x1874206962792704:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 268us (475us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787383295.028640:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1787383295.162945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.163066:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962792960 00000100:00100000:1.0:1787383295.163077:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962792960 00000100:00100000:1.0:1787383295.163143:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1787383295.163154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:10467:x1874206962792960:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:1.0:1787383295.163182:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.163204:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b22f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163302:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163317:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163329:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163351:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163358:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163365:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163711:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163723:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163730:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383295.163741:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787383295.163837:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163845:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163852:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163858:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.163862:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163933:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163946:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383295.163949:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.163954:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163959:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163972:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163978:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163983:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163988:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.163991:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.163997:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.164003:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425600) 00010000:00010000:1.0:1787383295.164005:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.164008:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.164023:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf14e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.164073:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b22f expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.164087:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b22f expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.164094:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.164096:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383295.164099:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b600, rc 0) 00000100:00100000:1.0:1787383295.164162:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:10467:x1874206962792960:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1010us (1228us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787383295.164171:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:0.0:1787383295.173586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.173785:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962793216 00000100:00100000:3.0:1787383295.173795:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962793216 00000100:00100000:3.0:1787383295.173860:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1787383295.173904:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:10467:x1874206962793216:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:3.0:1787383295.174163:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10467:x1874206962793216:12345-192.168.202.19@tcp:35:cat.0 Request processed in 262us (584us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787383295.174172:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1787383295.203507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.203613:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962793472 00000100:00100000:1.0:1787383295.203624:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962793472 00000100:00100000:1.0:1787383295.203697:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:1.0:1787383295.203708:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10468:x1874206962793472:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:1.0:1787383295.203769:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787383295.203799:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b22f expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203823:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf12b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b228 expref: 32 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203864:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf0f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b21a expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203910:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.203922:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383295.203944:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203956:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203965:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203978:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203985:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.203991:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.204328:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.204336:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.204343:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383295.205070:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787383295.205081:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319419212283ns, next at 320419209602ns, rc = 0 00010000:00010000:1.0:1787383295.205149:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205160:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205169:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205176:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205182:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205188:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205220:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383295.205244:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205250:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205256:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205262:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.205273:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205281:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205292:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383295.205295:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787383295.205298:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205304:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf171 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205322:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205328:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205333:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205338:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.205341:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205346:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205353:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383295.205355:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.205365:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.205371:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf163 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383295.205381:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc731f07 reply state 0000000012a043df transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.205389:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383295.205483:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:10468:x1874206962793472:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1774us (1982us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787383295.205492:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00010000:00010000:2.0:1787383295.205726:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383295.205733:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.205751:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383295.205755:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.205761:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.205771:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383295.205773:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383295.205776:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.205781:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.205797:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383295.205799:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383295.205801:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383295.212094:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212115:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212123:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212129:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.212135:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212143:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212163:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425600) 00010000:00010000:1.0:1787383295.212166:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.212171:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.212208:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf16a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.257380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.258102:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962793728 00000100:00100000:1.0:1787383295.258112:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962793728 00000100:00100000:1.0:1787383295.258469:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:1.0:1787383295.258482:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:10474:x1874206962793728:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383295.258508:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.258532:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf17f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b236 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258663:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258678:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258700:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258715:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258723:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.258730:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787383295.259542:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787383295.259759:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259773:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259783:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259819:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259827:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259833:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259839:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.259844:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259851:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259863:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383295.259909:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.259914:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259921:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf186 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383295.259945:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b6ccd81 reply state 00000000853ef660 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.259954:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787383295.259984:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf17f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.259996:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.260003:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.260005:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383295.260008:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b600, rc 0) 00000100:00100000:1.0:1787383295.260080:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:10474:x1874206962793728:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1601us (2711us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787383295.260088:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00010000:00010000:2.0:1787383295.264304:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264326:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264335:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264341:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383295.264346:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264375:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264394:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425600) 00010000:00010000:2.0:1787383295.264397:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383295.264401:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.264408:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf18d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.265716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.265911:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962793856 00000100:00100000:3.0:1787383295.265927:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962793856 00000100:00100000:3.0:1787383295.266004:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1787383295.266016:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962793856:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383295.266039:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383295.266074:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b23d expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383295.266101:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383295.266121:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1787383295.266125:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383295.266134:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.266153:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.266167:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383295.266969:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962793856:12345-192.168.202.19@tcp:101:bash.0 Request processed in 950us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.266979:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00080000:0.0:1787383295.267257:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383295.270525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.270614:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962793984 00000100:00100000:1.0:1787383295.270625:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962793984 00000100:00100000:1.0:1787383295.270695:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1787383295.270706:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3505f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:10474:x1874206962793984:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383295.270727:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.270746:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b244 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.270780:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.270811:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383295.270816:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383295.270821:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.270855:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.270902:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.270917:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979589248:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383295.271015:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383295.275585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.275758:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979589248:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383295.275793:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.275814:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6be00, rc 0) 00000100:00100000:1.0:1787383295.275909:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3505f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:10474:x1874206962793984:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5204us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.275919:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1787383295.276518:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794112 00000100:00100000:0.0:1787383295.276527:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794112 00010000:00010000:0.0:1787383295.276562:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.276591:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1787383295.276601:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962794112:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383295.276615:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383295.276639:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383295.276652:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383295.276678:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fafb232/0x42020b050d5cf1a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b23d expref: 7 pid: 6599 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383295.276703:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383295.276707:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383295.276727:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383295.276738:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383295.276773:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.276787:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1874206979589376:192.168.202.19@tcp:105: 00000100:00100000:0.0:1787383295.276903:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0ccbb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383295.281613:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1874206979589376:192.168.202.19@tcp:105: 00010000:00010000:0.0:1787383295.281641:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383295.281701:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962794112:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5101us (6125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383295.281713:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1787383295.285209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.285448:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794368 00000100:00100000:3.0:1787383295.285458:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794368 00000100:00100000:3.0:1787383295.285511:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1787383295.285520:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:10474:x1874206962794368:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1787383295.285941:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:10474:x1874206962794368:12345-192.168.202.19@tcp:35:bash.0 Request processed in 420us (742us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787383295.285950:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1787383295.459606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.459755:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794496 00000100:00100000:1.0:1787383295.459768:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794496 00000100:00100000:1.0:1787383295.459848:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1787383295.459858:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:10490:x1874206962794496:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383295.459917:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.459948:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b24b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460017:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460031:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460042:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383295.460101:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787383295.460105:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383295.460128:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460152:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b24b expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460169:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b24b expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.460179:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383295.460182:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383295.460185:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b400, rc 0) 00000100:00100000:1.0:1787383295.460246:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:10490:x1874206962794496:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 389us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.460273:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:0.0:1787383295.472716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383295.472769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383295.472803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.472908:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794880 00000100:00100000:1.0:1787383295.472918:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794880 00000100:00100000:1.0:1787383295.472989:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:1.0:1787383295.472999:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962794880:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383295.473076:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962794880:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.473084:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00080000:0.0:1787383295.473158:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383295.473474:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794624 00000100:00100000:3.0:1787383295.473480:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794624 00000100:00100000:3.0:1787383295.473534:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 287 00000100:00100000:3.0:1787383295.473541:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962794624:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383295.473574:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962794624:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.473580:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 287 00000100:00100000:2.0:1787383295.473862:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962794752 00000100:00100000:2.0:1787383295.473902:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962794752 00000100:00100000:2.0:1787383295.473942:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1787383295.473950:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2351:x1874206962794752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383295.473982:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2351:x1874206962794752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.473988:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:0.0:1787383295.492417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.492550:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795136 00000100:00100000:1.0:1787383295.492561:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795136 00000100:00100000:1.0:1787383295.492629:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1787383295.492640:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:10490:x1874206962795136:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383295.492662:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.492692:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b252 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.492791:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf1c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.492804:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.492816:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383295.492828:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787383295.492981:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b252 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.493018:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b252 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.493027:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.493030:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383295.493034:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ba00, rc 0) 00000100:00100000:1.0:1787383295.493111:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:10490:x1874206962795136:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 473us (703us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787383295.493120:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:0.0:1787383295.504218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383295.507668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.507791:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795520 00000100:00100000:2.0:1787383295.507805:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795520 00000100:00100000:2.0:1787383295.507932:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1787383295.507944:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:2348:x1874206962795520:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383295.507961:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383295.507987:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf1c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b252 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.508026:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:2.0:1787383295.508031:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383295.508098:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:2348:x1874206962795520:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 155us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.508106:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1787383295.512029:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795392 00000100:00100000:1.0:1787383295.512045:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795392 00000100:00100000:1.0:1787383295.512125:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:1.0:1787383295.512136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:10490:x1874206962795392:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383295.512162:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.512183:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b259 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.512560:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.512577:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.512588:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383295.512602:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787383295.513546:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b259 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.513569:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b259 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.513577:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:1.0:1787383295.513580:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787383295.513583:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383295.513720:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:10490:x1874206962795392:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1585us (9511us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787383295.513730:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1787383295.541961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.542061:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795648 00000100:00100000:1.0:1787383295.542071:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795648 00000100:00100000:1.0:1787383295.542136:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1787383295.542147:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962795648:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:1.0:1787383295.542204:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.542229:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.542239:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383295.542244:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383295.542248:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.542298:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.542327:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 6 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.542343:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979589504:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383295.542439:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383295.547409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.547635:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979589504:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383295.547666:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.548060:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795776 00000100:00100000:3.0:1787383295.548068:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795776 00002000:00100000:3.0:1787383295.548118:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ffc37e8df80 x1874206962795776/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:81/0 lens 504/0 e 0 to 0 dl 1787383306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787383295.548128:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37e8df80 with x1874206962795776 ext(0->8) 00010000:00010000:3.0:1787383295.548136:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 7 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.548150:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 7 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383295.548157:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc37e8df80 00000100:00100000:3.0:1787383295.548315:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1787383295.548326:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962795776:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1787383295.551076:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962795776:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 2742us (3667us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787383295.551096:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00100000:2.0:1787383295.551109:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ffc37e8df80 x1874206962795776/t4294967302(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:81/0 lens 504/448 e 0 to 0 dl 1787383306 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383295.551120:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37e8df80 with x1874206962795776 ext(0->8) 00010000:00010000:2.0:1787383295.551131:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.551151:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383295.551159:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc37e8df80 00000100:00100000:0.0:1787383295.556168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.556400:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962795904 00000100:00100000:3.0:1787383295.556412:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962795904 00010000:00010000:3.0:1787383295.556454:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.556527:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1787383295.556537:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962795904:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.556576:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787383295.556595:0:5790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787383295.556599:0:5790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787383295 00002000:00010000:3.0:1787383295.556601:0:5790:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787383296 00002000:00010000:3.0:1787383295.556603:0:5790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787383295 00010000:00010000:3.0:1787383295.556610:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.556624:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.556651:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cf1a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b244 expref: 9 pid: 6601 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.556667:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383295.556672:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383295.556678:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.556699:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.556732:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.556789:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962795904:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 253us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.556797:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00010000:00010000:1.0:1787383295.557329:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557340:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557369:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557377:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557385:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557404:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383295.557409:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557418:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557432:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.557440:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf1e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.557516:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2351:x1874206962795648:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 15370us (15564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.557526:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1787383295.568625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.568792:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962796160 00000100:00100000:3.0:1787383295.568804:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962796160 00000100:00100000:3.0:1787383295.568903:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1787383295.568914:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:10490:x1874206962796160:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:3.0:1787383295.569182:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b259 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383295.569671:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787383295.572119:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787383295.576702:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787383295.576802:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.576823:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.576860:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.576921:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.576939:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 42 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.576958:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979589632:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383295.577053:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383295.580446:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979589632:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383295.580479:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.583719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.584446:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962796288 00000100:00100000:2.0:1787383295.584458:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962796288 00010000:00010000:2.0:1787383295.584509:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 43 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.584561:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1787383295.584571:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:2348:x1874206962796288:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383295.584587:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383295.584594:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 43 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584608:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 43 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584635:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b236 expref: 43 pid: 5805 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584669:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:2.0:1787383295.584675:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584697:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584705:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.584743:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383295.584808:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:2348:x1874206962796288:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 237us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.584817:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00010000:00010000:1.0:1787383295.585029:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.585037:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383295.585179:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787383295.585404:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787383295.585532:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979589760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787383295.585773:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383295.585811:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff03000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383295.585987:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979589760 00000100:00100000:2.0:1787383295.585993:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979589760 00000100:00100000:2.0:1787383295.586037:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383295.586046:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979589760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383295.586113:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979589760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.586120:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787383295.586338:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383295.586897:0:5806:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787383295.586908:0:5806:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787383295.586932:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc0512ce00, transno 4294967301 00000100:00100000:1.0:1787383295.586956:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979589760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787383295.588899:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787383295.588995:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979589888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787383295.589077:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383295.589158:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383295.592356:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979589888 00000100:00100000:2.0:1787383295.592372:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979589888 00000100:00100000:2.0:1787383295.592604:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383295.592619:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874206979589888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383295.592926:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1874206979589888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 309us (3847us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787383295.593034:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979589888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787383295.593132:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787383295.593183:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593194:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593202:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593208:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383295.593213:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593219:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593236:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383295.593239:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787383295.593243:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.593261:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf1ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383295.593704:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787383295.593804:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787383295.593816:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319807947464ns, next at 320807945017ns, rc = 0 00000001:00080000:3.0:1787383295.593823:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787383295.593856:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425800) 00010000:00010000:3.0:1787383295.593860:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787383295.593907:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf1da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b259 expref: 46 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.594019:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:10490:x1874206962796160:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 25107us (25407us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787383295.594028:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000020:00080000:3.0:1787383295.594034:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787383295.594472:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383295.602205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.602305:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962796416 00000100:00100000:1.0:1787383295.602317:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962796416 00000100:00100000:1.0:1787383295.602379:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:1.0:1787383295.602390:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:10490:x1874206962796416:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383295.602415:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383295.602441:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b260 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.602511:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b260 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.602526:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b260 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.602568:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.602571:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383295.602575:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6bc00, rc 0) 00000100:00100000:1.0:1787383295.602636:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:10490:x1874206962796416:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 248us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.602644:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1787383295.609022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.611584:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962796672 00000100:00100000:2.0:1787383295.611600:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962796672 00000100:00100000:2.0:1787383295.611688:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1787383295.611701:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:10490:x1874206962796672:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383295.612666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10490:x1874206962796672:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 962us (3650us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787383295.612676:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1787383295.688081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.688192:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962796800 00000100:00100000:1.0:1787383295.688203:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962796800 00000100:00100000:1.0:1787383295.688287:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:1.0:1787383295.688297:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10500:x1874206962796800:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1787383295.688376:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688392:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688404:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688421:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688428:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688434:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688538:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688560:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688568:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383295.688611:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688625:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688632:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688639:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688645:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.688649:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688657:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688670:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383295.688673:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.688687:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688694:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf1fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688715:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688721:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688726:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688730:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.688733:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688738:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688745:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc01425f00) 00010000:00010000:1.0:1787383295.688747:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.688749:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688754:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688767:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688771:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688776:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688787:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.688790:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688795:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688801:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.688803:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.688805:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.688810:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf20b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.688939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10500:x1874206962796800:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 642us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.688948:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:0.0:1787383295.775028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.775117:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962797056 00000100:00100000:3.0:1787383295.775127:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962797056 00000100:00100000:3.0:1787383295.775191:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:3.0:1787383295.775202:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:10503:x1874206962797056:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383295.775226:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383295.775248:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b267 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775360:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775375:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775388:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775415:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775423:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775430:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775562:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775571:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775578:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383295.775589:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787383295.775707:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775715:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775729:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775734:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383295.775739:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775747:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775761:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383295.775764:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383295.775768:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775774:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775788:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775794:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775799:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775804:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383295.775806:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775824:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775834:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc094fe200) 00010000:00010000:3.0:1787383295.775836:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383295.775839:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775844:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775942:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b267 expref: 50 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775956:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b267 expref: 49 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.775964:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383295.775966:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383295.775968:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383295.776038:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:10503:x1874206962797056:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 837us (1019us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787383295.776047:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1787383295.791408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.791521:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962797184 00000100:00100000:1.0:1787383295.791532:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962797184 00000100:00100000:1.0:1787383295.791610:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:1.0:1787383295.791620:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:10503:x1874206962797184:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383295.791704:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791723:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791738:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791786:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791793:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791798:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791804:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.791808:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791816:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791828:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.791832:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383295.791836:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.791855:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.791977:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:10503:x1874206962797184:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 357us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.791985:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:2.0:1787383295.795917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.796676:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962797440 00000100:00100000:3.0:1787383295.796697:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962797440 00000100:00100000:3.0:1787383295.796755:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1787383295.796765:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:10503:x1874206962797440:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383295.797381:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:10503:x1874206962797440:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 616us (1517us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787383295.797390:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:0.0:1787383295.818219:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383295.950312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.950536:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962797696 00000100:00100000:2.0:1787383295.950560:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962797696 00000100:00100000:2.0:1787383295.950641:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:2.0:1787383295.950652:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:10513:x1874206962797696:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383295.950712:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383295.950716:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787383295.950745:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf1b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b24b expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.950767:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383295.950773:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383295.950789:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf23c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b26e expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.950967:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.950982:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.950992:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383295.951020:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787383295.951168:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf23c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 52 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.951183:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.951191:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383295.951193:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383295.951196:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383295.951279:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:10513:x1874206962797696:12345-192.168.202.19@tcp:101:bash.0 Request processed in 618us (968us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787383295.951287:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:0.0:1787383295.963531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383295.963611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383295.963725:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798080 00000100:00100000:1.0:1787383295.963740:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798080 00000100:00100000:1.0:1787383295.963806:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:1.0:1787383295.963827:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:10513:x1874206962798080:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1787383295.963943:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383295.963973:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b267 expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.963994:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.963999:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383295.964202:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.964215:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.964225:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.964255:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.964268:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.964282:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979590016:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383295.964358:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc277240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383295.964904:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962797824 00000100:00100000:3.0:1787383295.964910:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962797824 00010000:00010000:3.0:1787383295.964937:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 52 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.964971:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1787383295.964980:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:2350:x1874206962797824:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.964989:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383295.964995:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 52 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.965005:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 52 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.965077:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383295.965083:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.965092:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.965099:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.965129:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.965170:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:2350:x1874206962797824:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 191us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.965178:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00010000:00010000:1.0:1787383295.967820:0:5803:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.19@tcp) returned -22 from blocking AST (req@0000000023f1bc7b x1874206979590016) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.967847:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b26e expref: 51 pid: 8068 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.967910:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979590016:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383295.967940:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.967950:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.967960:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.967965:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383295.968122:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787383295.968178:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed8b06b5 reply state 000000008977b2f9 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.968188:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383295.968314:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:10513:x1874206962798080:12345-192.168.202.19@tcp:36:bash.0 Request processed in 4489us (4701us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787383295.968323:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000020:00080000:1.0:1787383295.968328:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787383295.976740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383295.977237:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798208 00000100:00100000:3.0:1787383295.977260:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798208 00000100:00100000:3.0:1787383295.977328:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:3.0:1787383295.977340:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:10513:x1874206962798208:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383295.977369:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383295.977392:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b275 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.977737:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.977749:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.977756:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.977774:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.977784:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.978973:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.978989:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.978996:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979019:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383295.979023:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979030:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979047:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383295.979050:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383295.979065:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979074:0:3298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979080:0:3298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979121:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.979129:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf251 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.980238:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.980270:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383295.980330:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787383295.980335:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383295.980359:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.980414:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.980433:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.980442:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383295.980445:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383295.980448:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383295.980542:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:10513:x1874206962798208:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3203us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.980552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:0.0:1787383295.992733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383295.995724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798464 00000100:00100000:2.0:1787383295.995744:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798464 00000100:00100000:2.0:1787383295.995834:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1787383295.995854:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:10513:x1874206962798464:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1787383295.996168:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+53:10513:x1874206962798464:12345-192.168.202.19@tcp:35:bash.0 Request processed in 315us (3446us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787383295.996176:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1787383296.089244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.089350:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798592 00000100:00100000:2.0:1787383296.089362:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798592 00000100:00100000:2.0:1787383296.089452:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:2.0:1787383296.089463:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+53:10519:x1874206962798592:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383296.089504:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.089527:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b27c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089597:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089612:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089623:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383296.089708:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787383296.089711:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383296.089728:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089748:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b27c expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089764:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b27c expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.089770:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383296.089773:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383296.089775:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514400, rc 0) 00000100:00100000:2.0:1787383296.089829:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962798592:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 369us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.090565:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00080000:0.0:1787383296.090715:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383296.093528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.093613:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798720 00000100:00100000:2.0:1787383296.093624:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798720 00000100:00100000:2.0:1787383296.093694:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:2.0:1787383296.093704:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962798720:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383296.093727:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.093750:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b283 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093814:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093830:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093853:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093889:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093895:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093899:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093992:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.093997:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094017:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383296.094049:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787383296.094053:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383296.094065:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094073:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094079:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094083:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094087:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094090:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383296.094093:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094098:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094107:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383296.094109:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383296.094111:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094122:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf27b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094132:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094136:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094140:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094143:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383296.094144:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094148:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094151:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383296.094153:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383296.094154:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094157:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094179:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b283 expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094189:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b283 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.094201:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383296.094203:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383296.094206:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514e00, rc 0) 00000100:00100000:2.0:1787383296.094270:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10519:x1874206962798720:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 567us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.094278:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:3.0:1787383296.099411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383296.099480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383296.099580:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799104 00000100:00100000:0.0:1787383296.099591:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799104 00000100:00100000:0.0:1787383296.099661:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383296.099672:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:2348:x1874206962799104:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383296.099699:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383296.099728:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b283 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.099753:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383296.099759:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383296.099834:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:2348:x1874206962799104:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.099852:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1787383296.100071:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962798976 00000100:00100000:2.0:1787383296.100076:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962798976 00000100:00100000:2.0:1787383296.100107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:2.0:1787383296.100115:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962798976:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383296.100133:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.100149:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b28a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.100248:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.100261:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.100269:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.100306:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.100320:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 55 pid: 5804 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383296.100347:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979590144:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383296.100425:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383296.102740:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979590144:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383296.102772:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383296.104909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383296.105901:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799232 00000100:00100000:0.0:1787383296.105940:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799232 00010000:00010000:0.0:1787383296.105979:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 56 pid: 5804 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383296.106016:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1787383296.106026:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:2348:x1874206962799232:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383296.106041:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383296.106048:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 56 pid: 5804 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106061:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 56 pid: 5804 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106080:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf25f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b275 expref: 56 pid: 5804 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106093:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383296.106098:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106104:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106109:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.106131:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383296.106178:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:2348:x1874206962799232:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 154us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.106194:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00010000:00010000:2.0:1787383296.106393:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.106410:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383296.106428:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787383296.106558:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.106573:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.106579:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383296.106582:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383296.106585:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515c00, rc 0) 00000100:00100000:2.0:1787383296.106614:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10519:x1874206962798976:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 6500us (7214us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787383296.106619:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1787383296.116979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383296.117289:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799488 00000100:00100000:0.0:1787383296.117299:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799488 00000100:00100000:0.0:1787383296.117365:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1787383296.117376:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10519:x1874206962799488:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:0.0:1787383296.117391:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383296.117622:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf1f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b260 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.117641:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383296.117646:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383296.117718:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962799488:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 342us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.117726:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1787383296.132692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.132796:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799616 00000100:00100000:2.0:1787383296.132821:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799616 00000100:00100000:2.0:1787383296.132927:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:2.0:1787383296.132938:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962799616:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:2.0:1787383296.133045:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.133064:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.133077:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383296.133280:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787383296.133370:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962799616:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 433us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.133379:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1787383296.137325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.137438:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799744 00000100:00100000:2.0:1787383296.137448:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799744 00000100:00100000:2.0:1787383296.137562:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:2.0:1787383296.137572:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:10519:x1874206962799744:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383296.137594:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.137619:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b291 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137689:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137700:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137740:0:5805:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137754:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137770:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383296.137773:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383296.137777:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.137785:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514800, rc 0) 00000100:00100000:2.0:1787383296.137982:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c86a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10519:x1874206962799744:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 412us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.137990:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00000040:00080000:3.0:1787383296.842170:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383296.842182:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383296.842231:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787383296.842257:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383296.842407:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979590272:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383296.842521:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf76c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787383296.845021:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383296.847641:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979590272:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383296.857904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.858175:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962799872 00000100:00100000:2.0:1787383296.858186:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962799872 00000100:00100000:2.0:1787383296.858262:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:2.0:1787383296.858274:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10520:x1874206962799872:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383296.858333:0:8068:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383296.858458:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10520:x1874206962799872:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 185us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.858466:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:3.0:1787383296.867120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383296.867233:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962800000 00000100:00100000:1.0:1787383296.867258:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962800000 00000100:00100000:1.0:1787383296.867320:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1787383296.867330:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10520:x1874206962800000:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383296.867426:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867442:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867454:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867469:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867476:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867483:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867509:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867518:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867526:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383296.867565:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787383296.867570:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383296.867582:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867592:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867606:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867612:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867619:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383296.867623:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867630:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867642:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:1.0:1787383296.867645:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383296.867649:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867655:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf2b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867677:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867684:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867690:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867695:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383296.867706:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867712:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867720:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ffc01425f00) 00010000:00010000:1.0:1787383296.867722:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383296.867725:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867731:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867745:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867751:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867757:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867762:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383296.867765:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867770:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867778:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383296.867780:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383296.867792:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.867797:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383296.867922:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10520:x1874206962800000:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 592us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.867931:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:0.0:1787383296.874178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.874537:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962800256 00000100:00100000:2.0:1787383296.874549:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962800256 00000100:00100000:2.0:1787383296.874616:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1787383296.874641:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:10520:x1874206962800256:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383296.874676:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.874700:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf2c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b298 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.874818:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.874834:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.874845:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383296.874859:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787383296.874986:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.874994:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875001:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875007:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383296.875011:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875018:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875031:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383296.875040:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383296.875046:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875052:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875095:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf2c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b298 expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875105:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:2.0:1787383296.875107:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383296.875111:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf2c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b298 expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.875121:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514000, rc 0) 00000100:00100000:2.0:1787383296.875193:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962800256:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 555us (1025us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787383296.875200:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1787383296.885167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383296.885292:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962800384 00000100:00100000:1.0:1787383296.885303:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962800384 00000100:00100000:1.0:1787383296.885378:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:1.0:1787383296.885388:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962800384:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787383296.885426:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787383296.885532:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962800384:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.885540:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1787383296.904180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.904299:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962800640 00000100:00100000:2.0:1787383296.904309:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962800640 00000100:00100000:2.0:1787383296.904382:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:2.0:1787383296.904393:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962800640:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383296.904413:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.904417:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787383296.904446:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf26d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b27c expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.904467:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:2.0:1787383296.904486:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383296.904501:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf2dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b29f expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383296.905017:0:8068:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787383296.905294:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.905308:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.905319:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.905386:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf2dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b29f expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.905402:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b29f expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.905411:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383296.905414:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383296.905417:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515a00, rc 0) 00000100:00100000:2.0:1787383296.905476:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:10520:x1874206962800640:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1084us (1305us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787383296.905484:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:0.0:1787383296.916124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383296.923024:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962800896 00000100:00100000:1.0:1787383296.923041:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962800896 00000100:00100000:1.0:1787383296.923128:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:1.0:1787383296.923139:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:10520:x1874206962800896:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383296.923200:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383296.923228:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf2e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b29f expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923265:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:1.0:1787383296.923278:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383296.923302:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923331:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923342:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923358:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923621:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923632:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923721:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923729:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923736:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923742:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383296.923746:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923753:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923763:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:1.0:1787383296.923772:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383296.923777:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf2f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923795:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923907:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923916:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923921:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383296.923924:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923931:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923939:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4fce3d5c (ffff9ffc01425f00) 00010000:00010000:1.0:1787383296.923942:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383296.923945:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923951:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf2f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4fce3d5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383296.924702:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962800896:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1560us (8583us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383296.924725:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:0.0:1787383296.938790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.939006:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962801024 00000100:00100000:2.0:1787383296.939016:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962801024 00000100:00100000:2.0:1787383296.939079:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1787383296.939090:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:10520:x1874206962801024:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383296.939127:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.939152:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2a6 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939192:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939206:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939218:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939335:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939356:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 57 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.939379:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383296.939382:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383296.939386:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514400, rc 0) 00000100:00100000:2.0:1787383296.939453:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:10520:x1874206962801024:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 364us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.939461:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:3.0:1787383296.946950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383296.947209:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962801280 00000100:00100000:2.0:1787383296.947220:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962801280 00000100:00100000:2.0:1787383296.947295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1787383296.947305:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:10520:x1874206962801280:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383296.947439:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.947456:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.947469:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383296.947743:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787383296.947754:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321161885291ns, next at 322161882212ns, rc = 0 00000004:00010000:2.0:1787383296.947847:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000266888b7 reply state 00000000299e577d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383296.947857:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383296.947982:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:10520:x1874206962801280:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 678us (1043us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787383296.947990:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:3.0:1787383296.952203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383296.952344:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962801408 00000100:00100000:0.0:1787383296.952353:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962801408 00000100:00100000:0.0:1787383296.952422:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:0.0:1787383296.952432:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:10520:x1874206962801408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383296.952460:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383296.952496:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2ad expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.952561:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.952577:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.952598:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:0.0:1787383296.952602:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383296.952606:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383296.952659:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:10520:x1874206962801408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 228us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.952676:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00010000:00010000:2.0:1787383296.953799:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953823:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953830:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953836:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383296.953841:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953899:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953917:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383296.953920:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383296.953924:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.953931:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf30e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383296.971715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383296.984802:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962801536 00000100:00100000:3.0:1787383296.984817:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962801536 00000100:00080000:0.0:1787383296.984994:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383296.987143:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1787383296.987169:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962801536:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787383296.987504:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962801536:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 347us (15800us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787383296.987512:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1787383297.005079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383297.007027:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962801792 00000100:00100000:3.0:1787383297.007043:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962801792 00000100:00100000:3.0:1787383297.007119:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383297.007130:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:10520:x1874206962801792:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787383297.007400:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:10520:x1874206962801792:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 271us (2332us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787383297.007409:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1787383297.013724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.013839:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802048 00000100:00100000:2.0:1787383297.013850:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802048 00000100:00100000:2.0:1787383297.013954:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:2.0:1787383297.013964:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:10520:x1874206962802048:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383297.014076:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:10520:x1874206962802048:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 113us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.014084:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1787383297.018025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.018912:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802176 00000100:00100000:2.0:1787383297.018924:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802176 00000100:00100000:2.0:1787383297.018989:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1787383297.018999:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:10520:x1874206962802176:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.019021:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383297.019043:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf31c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2b4 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019115:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019145:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019157:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383297.019209:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383297.019229:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019272:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf31c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2b4 expref: 62 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019291:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2b4 expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.019300:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383297.019304:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383297.019307:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:2.0:1787383297.019371:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:10520:x1874206962802176:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 374us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.019379:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1787383297.023965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.024356:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802304 00000100:00100000:2.0:1787383297.024366:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802304 00000100:00100000:2.0:1787383297.024419:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1787383297.024429:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2348:x1874206962802304:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.024445:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383297.024478:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2bb expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383297.024504:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e01, blocks: 0x1 00010000:00010000:2.0:1787383297.024523:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1787383297.024527:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383297.024535:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 10 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.024552:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 10 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.024565:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515a00, rc 0) 00000100:00100000:2.0:1787383297.024613:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2348:x1874206962802304:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 186us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.024620:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1787383297.031490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.031578:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802560 00000100:00100000:2.0:1787383297.031589:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802560 00000100:00100000:2.0:1787383297.031654:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:2.0:1787383297.031664:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:10520:x1874206962802560:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383297.031781:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:10520:x1874206962802560:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.031789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:0.0:1787383297.036130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383297.036634:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802688 00000100:00100000:3.0:1787383297.036644:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802688 00000100:00100000:3.0:1787383297.036720:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1787383297.036730:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:10520:x1874206962802688:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383297.036752:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383297.036786:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2c2 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.037455:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.037469:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383297.037473:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383297.037479:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.037518:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.037683:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.037702:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979590400:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383297.037939:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383297.043133:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979590400:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383297.043176:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.043199:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98e00, rc 0) 00000100:00100000:1.0:1787383297.049201:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:10520:x1874206962802688:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 11454us (12062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.049221:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1787383297.050950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383297.051365:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802816 00000100:00100000:1.0:1787383297.051381:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802816 00010000:00010000:1.0:1787383297.051431:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383297.051488:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1787383297.051497:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:2348:x1874206962802816:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383297.051512:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383297.051546:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.051561:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.051583:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf32a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2bb expref: 11 pid: 6601 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.051617:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383297.051621:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383297.051630:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.051640:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.051715:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383297.051731:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979590528:192.168.202.19@tcp:105: 00000100:00100000:1.0:1787383297.051829:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383297.067835:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979590528:192.168.202.19@tcp:105: 00010000:00010000:1.0:1787383297.067865:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383297.067980:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2348:x1874206962802816:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 16482us (17042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.067991:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1787383297.073036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.073182:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962802944 00000100:00100000:2.0:1787383297.073201:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962802944 00002000:00100000:2.0:1787383297.073263:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ffc37e8d180 x1874206962802944/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:83/0 lens 504/0 e 0 to 0 dl 1787383308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383297.073301:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37e8d180 with x1874206962802944 ext(0->12) 00002000:00010000:2.0:1787383297.073308:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc37e8d180 00000100:00100000:2.0:1787383297.073350:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1787383297.073360:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2349:x1874206962802944:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787383297.074118:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:2349:x1874206962802944:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 754us (1093us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787383297.074128:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:2.0:1787383297.074135:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ffc37e8d180 x1874206962802944/t4294967308(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:83/0 lens 504/448 e 0 to 0 dl 1787383308 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383297.074144:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37e8d180 with x1874206962802944 ext(0->12) 00002000:00010000:2.0:1787383297.074148:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc37e8d180 00000100:00100000:3.0:1787383297.076913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.077066:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803072 00000100:00100000:2.0:1787383297.077084:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803072 00000100:00100000:2.0:1787383297.077223:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:2.0:1787383297.077236:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:10520:x1874206962803072:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787383297.220677:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000020:00080000:1.0:1787383297.220709:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc37f02a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787383297.220717:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc3501e600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc37f02cc0 00000020:00080000:1.0:1787383297.220721:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc3501ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc3ff17800 00000020:00080000:0.0:1787383297.220755:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:1.0:1787383297.220761:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787383297.220821:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc08b1a180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787383297.220825:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b8bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc08b1af00 00000020:00080000:1.0:1787383297.220829:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc2d4f1400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc0658e000 00000001:00080000:1.0:1787383297.220905:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787383297.220911:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787383297.220973:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787383297.220988:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787383297.221150:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979590656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787383297.221283:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979590912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787383297.221343:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383297.221394:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979590656 00000100:00100000:1.0:1787383297.221407:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979590656 00000100:00100000:0.0:1787383297.221439:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383297.221450:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979590784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787383297.221490:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383297.221501:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979590656:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787383297.221512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1787383297.221545:0:6600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787383297.221579:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.221609:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 11 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.221619:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787383297.221623:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383297.221629:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.221678:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 11 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.221712:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 11 pid: 6600 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383297.221726:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979591040:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383297.221812:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383297.221834:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787383297.221842:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787383297.222447:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1787383297.222674:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787383297.222894:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787383297.223004:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10520:x1874206962803072:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 145766us (146149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383297.223013:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1787383297.223055:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383297.223088:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383297.223097:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979590784 00000100:00100000:0.0:1787383297.223104:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979590784 00000100:00100000:0.0:1787383297.223132:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383297.223137:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979590912 00000100:00100000:0.0:1787383297.223139:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979590912 00000100:00080000:0.0:1787383297.223161:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383297.227476:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383297.227501:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979590784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787383297.227788:0:11924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787383297.227792:0:11924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787383297 00002000:00010000:1.0:1787383297.227795:0:11924:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787383297.227797:0:11924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787383297 -> 1787383297 00002000:00010000:1.0:1787383297.227799:0:11924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787383297.228067:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1874206979590784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 573us (6558us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787383297.228077:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383297.228102:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383297.228112:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979590912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787383297.228137:0:11924:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787383297.228172:0:11924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a894dff, atime: 0x6a894e00, ctime: 0x6a894dff, blocks: 0x1 00010000:00010000:1.0:1787383297.228181:0:11924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.228588:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1787383297.228593:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383297.228601:0:11924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.228620:0:11924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.228633:0:11924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.228642:0:11924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.228686:0:11924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787383297.229385:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979590912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1270us (6324us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787383297.229396:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787383297.229504:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383297.229514:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.229527:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383297.229533:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.229559:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.229581:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.229589:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da74758/0x42020b050d5cf33f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.229614:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383297.229616:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383297.229617:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383297.233062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000004:00080000:0.0:1787383297.233437:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc37e8c380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787383297.233449:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979590912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787383297.233488:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803200 00000100:00100000:0.0:1787383297.233500:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803200 00000100:00100000:0.0:1787383297.233584:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1787383297.233595:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:2348:x1874206962803200:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787383297.233834:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979591040:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383297.233891:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.243038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383297.243578:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803328 00000100:00100000:0.0:1787383297.243595:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803328 00010000:00010000:0.0:1787383297.243651:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 13 pid: 6600 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.243743:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1787383297.243756:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962803328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383297.243775:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383297.243782:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 13 pid: 6600 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.243799:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 13 pid: 6600 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.243834:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf0fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b221 expref: 13 pid: 6600 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.243854:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383297.243859:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00000004:00080000:2.0:1787383297.244028:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc37e8ea00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787383297.244038:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979590784:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787383297.244510:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.244525:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.244568:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383297.244637:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:2349:x1874206962803328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 882us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383297.244646:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00010000:00010000:2.0:1787383297.244849:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.244859:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.244923:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.244931:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.244951:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383297.245742:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874206979590656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24238us (24503us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787383297.245754:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787383297.245793:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383297.245801:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.245812:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383297.245817:0:11031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.245828:0:11031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.245848:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.245855:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d1f0815/0x42020b050d5cf338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.245912:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383297.245914:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383297.245916:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787383297.245957:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc37e8ce00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787383297.245966:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979590656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787383297.291682:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979591168:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.291784:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383297.291843:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383297.291850:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979591552:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.291905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383297.291939:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979591424:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.291978:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383297.292011:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383297.292017:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979591296:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383297.292076:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979591168 00000100:00100000:2.0:1787383297.292085:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979591168 00000100:00100000:2.0:1787383297.292142:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787383297.292151:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979591168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292214:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979591168:12345-0@lo:400:kworker.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.292223:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787383297.292264:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979591552 00000100:00100000:2.0:1787383297.292268:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979591552 00000100:00100000:2.0:1787383297.292327:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979591424 00000100:00100000:2.0:1787383297.292330:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979591424 00000100:00100000:2.0:1787383297.292345:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979591296 00000100:00100000:2.0:1787383297.292347:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979591296 00000100:00100000:2.0:1787383297.292362:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787383297.292369:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979591552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292404:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979591552:12345-0@lo:400:kworker.0 Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.292410:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787383297.292425:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787383297.292431:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979591424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979591424:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.292466:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787383297.292478:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787383297.292483:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979591296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292508:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979591296:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.292513:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787383297.292562:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979591552:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292574:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979591168:0@lo:400:kworker.0 00000100:00080000:2.0:1787383297.292604:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383297.292625:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979591296:0@lo:400:kworker.0 00000100:00100000:2.0:1787383297.292634:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979591424:0@lo:400:kworker.0 00000001:00080000:1.0:1787383297.314241:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787383297.314267:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1787383297.314279:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787383297.317814:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962803200:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 84201us (84748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383297.317834:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1787383297.334920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.340690:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803584 00000100:00100000:2.0:1787383297.340749:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803584 00000100:00100000:2.0:1787383297.340855:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:2.0:1787383297.341445:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10520:x1874206962803584:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.341539:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383297.341577:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2b4 expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.341603:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383297.341608:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383297.341654:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.341681:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.341692:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383297.342421:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c136f75e reply state 00000000d38a9400 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.342438:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383297.342601:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:10520:x1874206962803584:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1732us (7729us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787383297.342612:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:0.0:1787383297.349475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383297.349625:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803712 00000100:00100000:3.0:1787383297.349640:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803712 00000100:00100000:3.0:1787383297.349768:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1787383297.349780:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962803712:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787383297.350102:0:11924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787383297.350106:0:11924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787383297 -> 1787383296 00002000:00010000:3.0:1787383297.350109:0:11924:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787383296 00002000:00010000:3.0:1787383297.350112:0:11924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787383297 -> 1787383296 00002000:00010000:3.0:1787383297.350114:0:11924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787383297.350192:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962803712:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 414us (732us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787383297.350215:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00010000:00010000:1.0:1787383297.350504:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350518:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350526:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350532:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383297.350538:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350547:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350566:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383297.350569:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383297.350573:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.350579:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.352982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.355888:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962803968 00000100:00100000:2.0:1787383297.355910:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962803968 00000100:00100000:2.0:1787383297.356014:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:2.0:1787383297.356027:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:10520:x1874206962803968:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.356157:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.356178:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.356188:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.356238:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.356254:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 15 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.356272:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979591680:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383297.356402:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc275cdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383297.360597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.360597:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979591680:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383297.360652:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.360747:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804096 00000100:00100000:0.0:1787383297.360757:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804096 00010000:00010000:0.0:1787383297.360813:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.360861:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1787383297.363409:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:2348:x1874206962804096:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383297.363444:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383297.363459:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363478:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363529:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2a6 expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363550:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383297.363555:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363567:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363574:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.363675:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383297.363783:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:2348:x1874206962804096:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2726us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.363795:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00010000:00010000:2.0:1787383297.369414:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.369441:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.369494:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.369531:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.369540:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.370095:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383297.370104:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.370115:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.370140:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383297.370143:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787383297.370149:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.370155:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf34d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.370627:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10520:x1874206962803968:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 14523us (17577us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787383297.370640:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:3.0:1787383297.376382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.377112:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804224 00000100:00100000:2.0:1787383297.377129:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804224 00000100:00100000:2.0:1787383297.377199:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1787383297.377210:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962804224:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.377473:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.377515:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.377523:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383297.377528:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383297.377533:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.377642:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.377658:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 7 pid: 6599 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.377686:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979591808:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383297.377803:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc275cdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383297.383776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.383965:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979591808:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383297.384005:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.391173:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804352 00000100:00100000:0.0:1787383297.391192:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804352 00010000:00010000:0.0:1787383297.391344:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 8 pid: 6599 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.391407:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1787383297.391419:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962804352:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383297.391436:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383297.391466:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 8 pid: 6599 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.391482:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 8 pid: 6599 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.391513:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cf331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c2 expref: 8 pid: 6599 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.393317:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383297.393326:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383297.393336:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.393354:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.393403:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383297.393494:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962804352:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2070us (9728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383297.393506:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00010000:00010000:2.0:1787383297.394274:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394291:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394359:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394369:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394378:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394386:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383297.394391:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394402:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394422:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.394430:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d477e305/0x42020b050d5cf354 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.394519:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962804224:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 17306us (18149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.394530:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1787383297.400048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.400138:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804608 00000100:00100000:2.0:1787383297.400157:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804608 00000100:00100000:2.0:1787383297.400313:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:2.0:1787383297.400327:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10520:x1874206962804608:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787383297.400440:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.400462:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.400477:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.404227:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.404473:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.404483:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.404522:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 15 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.404539:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 15 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.404554:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979591936:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383297.404656:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383297.414001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.414131:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804736 00000100:00100000:2.0:1787383297.414149:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804736 00010000:00010000:2.0:1787383297.414214:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.414288:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1787383297.414300:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:2348:x1874206962804736:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383297.414325:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383297.414333:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.414350:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 16 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.414380:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383297.414386:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.414416:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.414424:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.414453:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383297.414532:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+16:2348:x1874206962804736:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 233us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.414540:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00010000:00010000:1.0:1787383297.414896:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ad expref: 15 pid: 8068 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383297.414916:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979591936:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383297.414943:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.414953:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.415025:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383297.415736:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787383297.417332:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787383297.417453:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787383297.417770:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979592064:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383297.417926:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383297.418673:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383297.418785:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979592064 00000100:00100000:2.0:1787383297.418796:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979592064 00000100:00100000:2.0:1787383297.418897:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383297.418908:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1874206979592064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383297.419376:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1874206979592064:12345-0@lo:1000:mdt00_001.0 Request processed in 467us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.419385:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383297.423809:0:5804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1787383297.423828:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1787383297.423857:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc37e8ea00, transno 4294967309 00000100:00100000:3.0:1787383297.424423:0:5804:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffc37e8ce00 x1874206979590656/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383313 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383297.424441:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979592064:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787383297.425131:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787383297.425252:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979592192:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787383297.425341:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383297.425378:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383297.425991:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979592192 00000100:00100000:1.0:1787383297.426001:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979592192 00000100:00100000:1.0:1787383297.426072:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383297.426084:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1874206979592192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383297.426382:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5804:x1874206979592192:12345-0@lo:1000:mdt00_001.0 Request processed in 299us (1040us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787383297.426391:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383297.426944:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1874206979592192:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787383297.430978:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431003:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431013:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431020:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383297.431027:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431035:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431058:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:3.0:1787383297.431061:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383297.431067:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431073:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf362 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431144:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431150:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431157:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431162:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383297.431165:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431171:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431180:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383297.431182:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383297.431193:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431205:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431215:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.431488:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.431522:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979592320:192.168.202.19@tcp:105: 00000100:00100000:3.0:1787383297.431647:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383297.434775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383297.434936:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1874206979592320:192.168.202.19@tcp:105: 00010000:00010000:1.0:1787383297.434985:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.434998:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf2a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435047:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435063:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435088:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435121:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435128:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435135:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435142:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383297.435147:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435156:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435169:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383297.435173:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383297.435177:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435184:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf369 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435195:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435201:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435208:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435220:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383297.435223:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435420:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435429:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383297.435432:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383297.435435:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.435440:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf35b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383297.435741:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10520:x1874206962804608:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 35415us (35710us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787383297.435754:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000020:00080000:1.0:1787383297.435763:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787383297.436793:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383297.436802:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787383297.437086:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962804864 00000100:00100000:0.0:1787383297.437099:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962804864 00000100:00100000:0.0:1787383297.437170:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:0.0:1787383297.437181:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10519:x1874206962804864:12345-192.168.202.19@tcp:49:lfs.0 00000100:00100000:0.0:1787383297.437472:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10519:x1874206962804864:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 291us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383297.437481:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000040:00080000:3.0:1787383297.439798:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787383297.439819:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383297.445649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383297.446803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383297.448315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962805376 00000100:00100000:3.0:1787383297.448337:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962805376 00000100:00100000:3.0:1787383297.448437:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:3.0:1787383297.448451:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:10520:x1874206962805376:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787383297.450736:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1787383297.453329:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962805120 00000100:00100000:1.0:1787383297.453352:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962805120 00000100:00100000:1.0:1787383297.453443:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:1.0:1787383297.453456:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10519:x1874206962805120:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:1.0:1787383297.454689:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787383297.454928:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10519:x1874206962805120:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1470us (10074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.454939:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000001:00080000:2.0:1787383297.457104:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787383297.457210:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457472:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457489:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457500:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457520:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457526:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.457640:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383297.457785:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10520:x1874206962805376:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 9332us (10986us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787383297.457796:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000020:00080000:2.0:1787383297.457804:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383297.463049:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383297.463352:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.463370:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383297.463400:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.463413:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.463438:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffc035c5300) 00010000:00010000:0.0:1787383297.463442:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787383297.463447:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383297.463454:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf370 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.468743:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383297.468754:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383297.468759:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383297.519471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.519611:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962805504 00000100:00100000:2.0:1787383297.519626:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962805504 00000100:00100000:2.0:1787383297.519718:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:2.0:1787383297.519731:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:10522:x1874206962805504:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383297.519768:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383297.519800:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2c9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.519937:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.519967:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.519982:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520023:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520032:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520038:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520441:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520457:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520467:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520514:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.520532:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 21 pid: 5803 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.520550:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979592448:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383297.520681:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc20be3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383297.528707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383297.528987:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962805760 00000100:00100000:1.0:1787383297.529016:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962805760 00000100:00100000:1.0:1787383297.529093:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1787383297.529105:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:5560:x1874206962805760:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787383297.529464:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:5560:x1874206962805760:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 359us (772us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787383297.529473:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1787383297.530309:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979592448:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383297.530454:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383297.538172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383297.538378:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962805888 00000100:00100000:2.0:1787383297.538394:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962805888 00010000:00010000:2.0:1787383297.538459:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 23 pid: 5803 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383297.538515:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1787383297.538529:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:2350:x1874206962805888:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383297.538552:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383297.538561:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 23 pid: 5803 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538578:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 23 pid: 5803 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538610:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf297 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b28a expref: 23 pid: 5803 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538632:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383297.538637:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538649:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383297.538711:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383297.538811:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:2350:x1874206962805888:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 283us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.538821:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00010000:00010000:3.0:1787383297.539155:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539166:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383297.539226:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787383297.539239:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383297.539267:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539283:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539296:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539314:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539321:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539328:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383297.539332:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539351:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539362:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383297.539365:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383297.539369:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539376:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf37e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539390:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539396:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539402:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539407:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383297.539415:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539422:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539429:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffc035c5700) 00010000:00010000:3.0:1787383297.539432:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383297.539435:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539441:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539490:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c9 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539506:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c9 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383297.539514:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383297.539516:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383297.539519:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514200, rc 0) 00000100:00100000:3.0:1787383297.539560:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10522:x1874206962805504:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 19832us (20105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383297.539568:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:3.0:1787383297.804903:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383297.804980:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383297.805181:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979592576 00000100:00100000:1.0:1787383297.805190:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979592576 00000100:00100000:1.0:1787383297.805243:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383297.805252:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874206979592576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383297.805289:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383297.805335:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874206979592576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.805343:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383297.805386:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979592576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383297.869299:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383298.318944:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979592704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383298.319024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383298.319154:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979592704 00000100:00100000:0.0:1787383298.319164:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979592704 00000100:00100000:0.0:1787383298.319224:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383298.319301:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979592704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383298.319325:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787383298.319377:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979592704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.319386:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383298.319922:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979592704:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787383298.448542:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383298.448555:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383298.448617:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787383298.448624:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383298.449540:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8ce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979592832:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787383298.449694:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08b1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383298.455525:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8ce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979592832:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383298.457505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383298.459494:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962806016 00000100:00100000:0.0:1787383298.459516:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962806016 00000100:00100000:0.0:1787383298.459623:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:0.0:1787383298.459637:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10533:x1874206962806016:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383298.459718:0:8068:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383298.459899:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10533:x1874206962806016:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 263us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.459908:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00080000:3.0:1787383298.460381:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383298.467452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383298.467551:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962806272 00000100:00100000:3.0:1787383298.467565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962806272 00000100:00100000:3.0:1787383298.467648:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:3.0:1787383298.467669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:10533:x1874206962806272:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383298.467699:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383298.467730:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf393 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2d0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383298.467917:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf39a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383298.467937:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383298.467951:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383298.467965:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787383298.468195:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf393 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d0 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383298.468218:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf39a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d0 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383298.468229:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383298.468232:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383298.468237:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:3.0:1787383298.468628:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10533:x1874206962806272:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 961us (1190us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787383298.468664:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:0.0:1787383298.484669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383298.484963:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962806528 00000100:00100000:1.0:1787383298.484979:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962806528 00000100:00100000:1.0:1787383298.485059:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:1.0:1787383298.485073:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:10533:x1874206962806528:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383298.485194:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485219:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485235:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485635:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485644:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485651:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485667:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383298.485672:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485680:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485696:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383298.485708:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383298.485714:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383298.485720:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf3a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383298.487462:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:10533:x1874206962806528:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 2377us (2805us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787383298.487480:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000040:00080000:0.0:1787383298.496116:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383298.496131:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383298.496603:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787383298.496614:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787383298.499931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383298.499989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383298.500032:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962806656 00000100:00100000:2.0:1787383298.500045:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962806656 00000100:00100000:2.0:1787383298.500130:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383298.500143:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:2351:x1874206962806656:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383298.500174:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383298.500208:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf39a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d0 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.500239:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00000100:00100000:1.0:1787383298.500348:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962806912 00000100:00100000:1.0:1787383298.500354:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962806912 00000100:00100000:1.0:1787383298.500392:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:1.0:1787383298.500400:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:10533:x1874206962806912:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787383298.500715:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:10533:x1874206962806912:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 314us (800us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787383298.500726:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:2.0:1787383298.501101:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383298.501180:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:2351:x1874206962806656:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 1039us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383298.501189:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000040:00080000:3.0:1787383298.648954:0:11962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383298.648966:0:11962:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383298.649022:0:11962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787383298.649028:0:11962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383298.876761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383298.876823:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807168 00000100:00100000:2.0:1787383298.876839:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807168 00000100:00100000:2.0:1787383298.876939:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:2.0:1787383298.876955:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:10546:x1874206962807168:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383298.876989:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383298.877018:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2d7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.877195:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf3b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.877221:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf3b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.877238:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf3b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383298.877255:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787383298.877518:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d7 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.877537:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf3b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d7 expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.877547:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383298.877550:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787383298.877555:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514000, rc 0) 00000100:00100000:2.0:1787383298.877642:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:10546:x1874206962807168:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 692us (898us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787383298.877661:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:1.0:1787383298.882704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383298.882793:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807296 00000100:00100000:2.0:1787383298.882808:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807296 00000100:00100000:2.0:1787383298.882910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1787383298.882924:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:10546:x1874206962807296:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1787383298.883023:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883045:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883079:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883114:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883122:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883130:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883137:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514e00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383298.883143:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883151:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883165:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383298.883169:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383298.883173:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.883179:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514e00/0x42020b050d5cf3c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383298.883298:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:10546:x1874206962807296:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 377us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383298.883308:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00010000:00010000:2.0:1787383298.903040:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383298.993687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383298.993763:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807424 00000100:00100000:2.0:1787383298.993779:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807424 00000100:00100000:2.0:1787383298.993899:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1787383298.993913:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962807424:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383298.993954:0:11924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383298.993989:0:11924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf3cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2de expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383298.994029:0:11924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a894e00, atime: 0x6a894e00, ctime: 0x6a894e00, blocks: 0xb 00010000:00010000:2.0:1787383298.994058:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1787383298.994064:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383298.994075:0:11924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf3cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2de expref: 7 pid: 11924 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.994096:0:11924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf3cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2de expref: 7 pid: 11924 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383298.994112:0:11924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514e00, rc 0) 00000100:00100000:2.0:1787383298.994202:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2351:x1874206962807424:12345-192.168.202.19@tcp:101:cat.0 Request processed in 293us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383298.994211:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00080000:0.0:1787383298.994696:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383299.009353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383299.011675:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807552 00000100:00100000:2.0:1787383299.011700:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807552 00002000:00100000:2.0:1787383299.011783:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ffc37f53100 x1874206962807552/t0(0) o3->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:85/0 lens 488/0 e 0 to 0 dl 1787383310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383299.011796:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37f53100 with x1874206962807552 ext(0->4095) 00002000:00010000:2.0:1787383299.011819:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc37f53100 00000100:00100000:2.0:1787383299.011856:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1787383299.011895:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962807552:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:2.0:1787383299.012201:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962807552:12345-192.168.202.19@tcp:3:cat.0 Request processed in 333us (5000us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787383299.012210:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:2.0:1787383299.012233:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ffc37f53100 x1874206962807552/t0(0) o3->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:85/0 lens 488/4536 e 0 to 0 dl 1787383310 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383299.012242:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37f53100 with x1874206962807552 ext(0->4095) 00002000:00010000:2.0:1787383299.012246:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc37f53100 00000001:00080000:2.0:1787383299.433807:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787383299.434160:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1787383299.924093:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383300.603322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383300.603368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383300.603485:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807808 00000100:00100000:3.0:1787383300.603499:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807808 00000100:00100000:3.0:1787383300.603595:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:3.0:1787383300.603608:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:2348:x1874206962807808:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383300.603720:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:2348:x1874206962807808:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 115us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383300.603729:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:1.0:1787383300.604188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383300.604233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383300.604263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383300.604293:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808064 00000100:00100000:1.0:1787383300.604299:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808064 00000100:00100000:1.0:1787383300.604335:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807936 00000100:00100000:1.0:1787383300.604355:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807936 00000100:00100000:3.0:1787383300.604475:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962807680 00000100:00100000:3.0:1787383300.604480:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962807680 00000100:00100000:3.0:1787383300.604511:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 289 00000100:00100000:3.0:1787383300.604520:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962807680:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383300.604566:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962807680:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383300.604573:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 289 00000100:00100000:1.0:1787383300.604727:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1787383300.604737:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962808064:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383300.604768:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962808064:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.604776:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1787383300.604795:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1787383300.604801:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962807936:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383300.604826:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962807936:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.604833:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1787383300.604859:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808192 00000100:00100000:1.0:1787383300.604863:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808192 00000100:00100000:1.0:1787383300.604932:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:1.0:1787383300.604939:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962808192:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383300.604966:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962808192:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.604973:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00080000:0.0:1787383300.605988:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383300.605998:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383300.606001:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383300.939518:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383301.962257:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383302.433422:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979593344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433599:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787383302.433607:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979592960:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433693:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979593472:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433722:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433752:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979593088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433777:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433794:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979593600:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433815:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433831:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383302.433836:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979593216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.433856:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383302.433923:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593344 00000100:00100000:3.0:1787383302.433932:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593344 00000100:00100000:3.0:1787383302.433995:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593600 00000100:00100000:3.0:1787383302.433998:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593600 00000100:00100000:3.0:1787383302.434026:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383302.434036:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979593344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434098:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979593344:12345-0@lo:400:kworker.0 Request processed in 63us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434106:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383302.434126:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787383302.434132:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979593600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434162:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979593600:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434168:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787383302.434188:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979592960 00000100:00100000:3.0:1787383302.434192:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979592960 00000100:00100000:3.0:1787383302.434227:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787383302.434234:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3312:x1874206979592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434265:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3312:x1874206979592960:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434271:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787383302.434301:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593472 00000100:00100000:3.0:1787383302.434305:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593472 00000100:00100000:3.0:1787383302.434331:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593088 00000100:00100000:3.0:1787383302.434333:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593088 00000100:00100000:3.0:1787383302.434344:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593216 00000100:00100000:3.0:1787383302.434346:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593216 00000100:00100000:3.0:1787383302.434359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787383302.434365:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979593472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434395:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979593472:12345-0@lo:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434401:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787383302.434412:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383302.434417:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434443:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979593088:12345-0@lo:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434449:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383302.434459:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383302.434466:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979593216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434491:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979593216:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383302.434497:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1787383302.434547:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383302.434561:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383302.434563:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383302.434606:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979592960:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434633:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979593472:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434644:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979593344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434684:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979593216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434694:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979593088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383302.434703:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787383302.434710:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787383302.434726:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc37e8c380, transno 4294967304 00000100:00100000:3.0:1787383302.434739:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979593600:0@lo:400:kworker.0 00000020:00080000:1.0:1787383302.520844:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1787383302.520905:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:1.0:1787383302.520940:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787383302.520969:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc2fcf70c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787383302.520975:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b02900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc2fcf7d80 00000020:00080000:1.0:1787383302.520979:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b02400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc1897cc00 00000020:00080000:1.0:1787383302.520995:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787383302.521269:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787383302.560086:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787383302.560145:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:0.0:1787383302.604380:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383302.604399:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383302.604500:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787383302.604507:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383302.924907:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979593728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383302.925006:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383302.925398:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593728 00000100:00100000:0.0:1787383302.925408:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593728 00000100:00100000:0.0:1787383302.925485:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383302.925495:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979593728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383302.925539:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383302.925603:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979593728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383302.925619:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383302.925837:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979593728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383302.987598:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383303.437083:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383303.437119:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979593856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383303.437215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383303.437928:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593856 00000100:00100000:0.0:1787383303.437941:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593856 00000100:00100000:0.0:1787383303.438026:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383303.438039:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979593856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383303.438089:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383303.438381:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979593856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 339us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383303.438391:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383303.443555:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787383303.443573:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc37e8ce00, transno 4294967310 00000004:00080000:2.0:1787383303.443616:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787383303.443674:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979593856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383304.010587:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383304.884986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383304.885090:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808320 00000100:00100000:0.0:1787383304.885101:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808320 00000100:00100000:0.0:1787383304.885179:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1787383304.885191:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10199:x1874206962808320:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787383304.885308:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10199:x1874206962808320:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 120us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383304.885316:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00080000:3.0:1787383304.885414:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383304.889551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383304.889662:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808576 00000100:00100000:1.0:1787383304.889673:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808576 00000100:00100000:1.0:1787383304.889748:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1787383304.889758:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:10199:x1874206962808576:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787383304.890423:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:10199:x1874206962808576:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 663us (879us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787383304.890432:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00010000:00010000:2.0:1787383305.034821:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383305.357089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383305.357170:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808704 00000100:00100000:3.0:1787383305.357180:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808704 00000100:00100000:3.0:1787383305.357263:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:3.0:1787383305.357274:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:10998:x1874206962808704:12345-192.168.202.19@tcp:101:lsof.0 00010000:00010000:3.0:1787383305.357296:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383305.357316:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf3d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2e5 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357412:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357427:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357439:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383305.357676:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787383305.357680:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383305.357772:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357798:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf3d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357816:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.357825:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:3.0:1787383305.357828:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383305.357832:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00080000:0.0:1787383305.358039:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383305.358101:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:10998:x1874206962808704:12345-192.168.202.19@tcp:101:lsof.0 Request processed in 828us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.358109:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:3.0:1787383305.713659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383305.713712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383305.713768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383305.713810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383305.713921:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809088 00000100:00100000:3.0:1787383305.713935:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809088 00000100:00100000:1.0:1787383305.713950:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809216 00000100:00100000:1.0:1787383305.713966:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809216 00000100:00100000:2.0:1787383305.714072:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808832 00000100:00100000:2.0:1787383305.714079:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808832 00000100:00100000:2.0:1787383305.714125:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00100000:2.0:1787383305.714139:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962808832:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383305.714259:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2350:x1874206962808832:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 122us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.714267:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00080000:0.0:1787383305.714788:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383305.714795:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383305.714809:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962808960 00000100:00100000:0.0:1787383305.714813:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962808960 00000100:00100000:0.0:1787383305.714856:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:0.0:1787383305.714864:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2350:x1874206962808960:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383305.714948:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2350:x1874206962808960:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.714955:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:1.0:1787383305.717076:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:1.0:1787383305.717101:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962809088:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383305.717193:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:1.0:1787383305.717202:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962809088:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 110us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383305.717216:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1787383305.717225:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962809216:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383305.717305:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2350:x1874206962809216:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 98us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.717313:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:2.0:1787383306.058105:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383307.082837:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383307.533008:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979593984:0@lo:400:kworker.0 00000100:00100000:0.0:1787383307.533068:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979594112:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383307.533179:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979594496:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533216:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383307.533243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383307.533249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979594368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533291:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383307.533322:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979594240:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533348:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383307.533384:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979593984 00000100:00100000:2.0:1787383307.533392:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979593984 00000100:00100000:2.0:1787383307.533438:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787383307.533448:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3313:x1874206979593984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533500:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3313:x1874206979593984:12345-0@lo:400:kworker.0 Request processed in 54us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383307.533508:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787383307.533546:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594368 00000100:00100000:2.0:1787383307.533550:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594368 00000100:00100000:2.0:1787383307.533598:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383307.533604:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979594368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533634:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979594368:12345-0@lo:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383307.533654:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383307.533672:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594496 00000100:00100000:2.0:1787383307.533675:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594496 00000100:00100000:2.0:1787383307.533699:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787383307.533717:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533747:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979594496:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383307.533753:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787383307.533763:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594240 00000100:00100000:2.0:1787383307.533766:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594240 00000100:00100000:2.0:1787383307.533788:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787383307.533793:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533820:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979594240:12345-0@lo:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383307.533825:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787383307.533859:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979594240:0@lo:400:kworker.0 00000100:00080000:2.0:1787383307.533906:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383307.533911:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383307.533935:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979594368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533944:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979593984:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.533953:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979594496:0@lo:400:kworker.0 00000100:00100000:0.0:1787383307.535719:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383307.535786:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979594624:0@lo:400:kworker.0 00000100:00100000:0.0:1787383307.535860:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383307.535864:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594112 00000100:00100000:2.0:1787383307.535910:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594112 00000100:00100000:0.0:1787383307.535951:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594624 00000100:00100000:0.0:1787383307.535960:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594624 00000100:00100000:2.0:1787383307.535977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787383307.535991:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979594112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383307.536027:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787383307.536040:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979594624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.536115:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979594112:12345-0@lo:400:kworker.0 Request processed in 122us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383307.536115:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979594624:12345-0@lo:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383307.536151:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383307.536153:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1787383307.536215:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383307.536893:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979594112:0@lo:400:kworker.0 00000100:00100000:2.0:1787383307.536915:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979594624:0@lo:400:kworker.0 00000001:00080000:2.0:1787383307.628237:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787383307.628261:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787383307.628298:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787383307.628313:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787383308.044340:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979594752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383308.044421:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383308.047441:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594752 00000100:00100000:1.0:1787383308.047456:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594752 00000100:00100000:1.0:1787383308.047530:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787383308.047542:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979594752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383308.049177:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383308.049285:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979594752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1741us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383308.049294:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787383308.053088:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979594752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383308.109390:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383308.558062:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979594880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383308.558784:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383308.558902:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979594880 00000100:00100000:2.0:1787383308.558911:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979594880 00000100:00100000:2.0:1787383308.558968:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383308.558978:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979594880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383308.559016:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383308.559064:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979594880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383308.559072:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383308.559444:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979594880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787383309.135063:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383309.422404:0:12166:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:21:48 (1787383308) 00010000:00010000:0.0:1787383310.154157:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383310.833552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383310.833613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383310.833649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383310.833685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383310.833720:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809600 00000100:00100000:1.0:1787383310.833733:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809600 00000100:00100000:1.0:1787383310.833805:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1787383310.833832:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962809600:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383310.833975:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962809600:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 146us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.833983:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:2.0:1787383310.834466:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809472 00000100:00100000:2.0:1787383310.834490:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809472 00000100:00100000:2.0:1787383310.834553:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809856 00000100:00100000:2.0:1787383310.834556:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809856 00000100:00100000:2.0:1787383310.834585:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:2.0:1787383310.834594:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962809472:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383310.834641:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962809472:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.834649:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:2.0:1787383310.834668:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:2.0:1787383310.834675:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2348:x1874206962809856:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383310.834701:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2348:x1874206962809856:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.834707:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:3.0:1787383310.836617:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809344 00000100:00100000:3.0:1787383310.836635:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809344 00000100:00100000:3.0:1787383310.836712:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00100000:3.0:1787383310.836721:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962809344:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383310.836798:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2348:x1874206962809344:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.836806:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00080000:0.0:1787383310.837522:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383310.837533:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383310.840508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383310.840682:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962809728 00000100:00100000:0.0:1787383310.840695:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962809728 00000100:00100000:0.0:1787383310.840793:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1787383310.840807:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962809728:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:2.0:1787383310.842162:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383310.842526:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962809728:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1719us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383310.842548:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1787383310.848421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383310.851746:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810112 00000100:00100000:2.0:1787383310.851765:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810112 00000100:00100000:2.0:1787383310.852474:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:2.0:1787383310.852491:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:11263:x1874206962810112:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383310.852518:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383310.852553:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf3e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2ec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852660:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852677:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852713:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852730:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852736:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.852742:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853297:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf3f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853309:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853317:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383310.853330:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787383310.853584:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853593:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853600:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853607:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383310.853618:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853627:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853641:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc094fe000) 00010000:00010000:2.0:1787383310.853645:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383310.853651:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853658:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf3e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853674:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853681:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853686:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853692:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383310.853694:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853700:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853708:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffc035c5300) 00010000:00010000:2.0:1787383310.853709:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383310.853719:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.853725:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf3ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.854321:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf3e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ec expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.854341:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ec expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.854350:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:2.0:1787383310.854352:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383310.854355:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383310.854453:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:11263:x1874206962810112:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1967us (6188us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787383310.854464:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:1.0:1787383310.859035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383310.859090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383310.859407:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810240 00000100:00100000:3.0:1787383310.859422:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810240 00000100:00100000:3.0:1787383310.859505:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383310.859517:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:2349:x1874206962810240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383310.859535:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.859576:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf3f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2ec expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.859599:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383310.859606:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383310.859682:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2349:x1874206962810240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 167us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.859688:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1787383310.864771:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810368 00000100:00100000:0.0:1787383310.864794:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810368 00000100:00100000:2.0:1787383310.865173:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:2.0:1787383310.865190:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:11263:x1874206962810368:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787383310.865348:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:11263:x1874206962810368:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 163us (6257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.865358:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00010000:00010000:3.0:1787383311.182188:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383311.819090:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383311.819100:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383311.819561:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787383311.819571:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787383312.203474:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383312.651542:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979595136:0@lo:400:kworker.0 00000100:00100000:0.0:1787383312.651616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383312.651666:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979595648:0@lo:400:kworker.0 00000100:00100000:0.0:1787383312.651699:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383312.651741:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383312.651746:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979595264:0@lo:400:kworker.0 00000100:00100000:0.0:1787383312.651765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383312.651791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595136 00000100:00100000:0.0:1787383312.651797:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595136 00000100:00100000:0.0:1787383312.651834:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595264 00000100:00100000:0.0:1787383312.651836:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595264 00000100:00100000:0.0:1787383312.651860:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787383312.651887:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979595136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383312.651988:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979595008:0@lo:400:kworker.0 00000100:00100000:2.0:1787383312.652009:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979595392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.652181:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787383312.652191:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979595264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.652243:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979595264:12345-0@lo:400:kworker.0 Request processed in 53us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.652259:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787383312.652300:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595648 00000100:00100000:1.0:1787383312.652304:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595648 00000100:00100000:1.0:1787383312.652331:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787383312.652337:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979595648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.652368:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979595648:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.652374:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383312.652784:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.652857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383312.653020:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595392 00000100:00100000:1.0:1787383312.653677:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595392 00000100:00100000:1.0:1787383312.653733:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787383312.653743:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979595392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.653798:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979595392:12345-0@lo:400:kworker.0 Request processed in 57us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.653805:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383312.654551:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979595520:0@lo:400:kworker.0 00000100:00100000:2.0:1787383312.654597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.654650:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595008 00000100:00100000:2.0:1787383312.654655:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595008 00000100:00100000:2.0:1787383312.654688:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787383312.654695:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3313:x1874206979595008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383312.654735:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3313:x1874206979595008:12345-0@lo:400:kworker.0 Request processed in 40us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.654743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787383312.654794:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979595008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.655013:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595520 00000100:00100000:1.0:1787383312.655018:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595520 00000100:00100000:1.0:1787383312.655056:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383312.655064:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979595520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.656208:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979595520:12345-0@lo:400:kworker.0 Request processed in 1138us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.656219:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383312.657372:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979595392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.658045:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979595520:0@lo:400:kworker.0 00000100:00080000:1.0:1787383312.658122:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383312.658136:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383312.658139:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383312.658211:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979595136:12345-0@lo:400:kworker.0 Request processed in 6342us (6594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.658221:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787383312.661852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979595264:0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.679939:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979595136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383312.679971:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979595648:0@lo:400:kworker.0 00000001:00080000:2.0:1787383312.712345:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1787383312.842164:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383312.842175:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383312.842744:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787383312.842754:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383313.162589:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383313.162614:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383313.162688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383313.163019:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979595776 00000100:00100000:2.0:1787383313.163027:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979595776 00000100:00100000:2.0:1787383313.163083:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383313.163102:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979595776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383313.163136:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383313.163185:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979595776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.163192:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383313.163376:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979595776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787383313.228529:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383313.327665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.328160:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810496 00000100:00100000:2.0:1787383313.328171:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810496 00000100:00100000:2.0:1787383313.328235:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:2.0:1787383313.328245:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:11306:x1874206962810496:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383313.328267:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383313.328288:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2f3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328360:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328373:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328383:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328396:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328403:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.328409:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383313.328560:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383313.329948:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.329964:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.329970:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.329975:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.329979:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.329995:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330010:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:2.0:1787383313.330012:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.330016:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330022:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf40a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330033:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330038:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330042:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330046:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.330049:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330054:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330059:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffc035c5300) 00010000:00010000:2.0:1787383313.330062:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.330064:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330077:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330120:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf403 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2f3 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330130:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:2.0:1787383313.330132:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.330135:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2f3 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.330146:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383313.330216:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:11306:x1874206962810496:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1972us (2559us total) trans 0 rc 301/301 00000100:00100000:2.0:1787383313.330224:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:3.0:1787383313.357892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383313.357932:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810752 00000100:00100000:3.0:1787383313.357942:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810752 00000100:00100000:3.0:1787383313.357988:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:3.0:1787383313.357997:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:11306:x1874206962810752:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:3.0:1787383313.358054:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383313.358084:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5ced81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b12c expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.358117:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:3.0:1787383313.358123:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383313.358404:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.358419:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 5 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.358428:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.358460:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 5 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.358605:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 5 pid: 8068 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.358628:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979595904:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383313.358714:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383313.361933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.362004:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962810880 00000100:00100000:2.0:1787383313.362013:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962810880 00010000:00010000:2.0:1787383313.362064:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 6 pid: 8068 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383313.362109:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1787383313.362118:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2349:x1874206962810880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383313.362133:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383313.362139:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 6 pid: 8068 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.362168:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 6 pid: 8068 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.362188:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:2.0:1787383313.362193:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.362202:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.362208:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.362225:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383313.362276:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2349:x1874206962810880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.362283:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00010000:00010000:3.0:1787383313.362760:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf3d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2e5 expref: 5 pid: 8068 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.362776:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979595904:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383313.362799:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.362807:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.362812:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.362839:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.362849:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.362857:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383313.364190:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787383313.364382:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787383313.364396:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364405:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364420:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364425:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383313.364430:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364438:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364452:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425000) 00010000:00010000:3.0:1787383313.364456:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383313.364460:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.364466:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf418 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383313.364564:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a19712ae reply state 0000000035310f5f transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.364572:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383313.364693:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:11306:x1874206962810752:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 6694us (6826us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787383313.364702:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00010000:00010000:2.0:1787383313.369017:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369036:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369044:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369050:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.369056:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369080:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369098:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffc094fec00) 00010000:00010000:2.0:1787383313.369101:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.369106:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.369112:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf41f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.431033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.431145:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811008 00000100:00100000:2.0:1787383313.431155:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811008 00000100:00100000:2.0:1787383313.431228:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:2.0:1787383313.431238:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:11314:x1874206962811008:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:2.0:1787383313.431266:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383313.431299:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b2fa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431366:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431380:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431390:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383313.431454:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787383313.431472:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383313.431506:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431541:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2fa expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431582:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2fa expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.431591:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:2.0:1787383313.431594:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383313.431597:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514400, rc 0) 00000100:00100000:2.0:1787383313.431656:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:11314:x1874206962811008:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 420us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.431663:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:1.0:1787383313.473403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383313.473495:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811136 00000100:00100000:3.0:1787383313.473506:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811136 00000100:00100000:3.0:1787383313.473578:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:3.0:1787383313.473589:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:11320:x1874206962811136:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383313.473624:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383313.473644:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b301 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473708:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473724:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473735:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473749:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473755:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473760:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473905:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473913:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473920:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383313.473951:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787383313.473959:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383313.473980:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473989:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473993:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.473998:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474002:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383313.474005:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474010:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474028:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:3.0:1787383313.474031:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383313.474034:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474038:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf43b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474048:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474052:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474063:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474066:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383313.474068:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474071:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474076:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffc094fe200) 00010000:00010000:3.0:1787383313.474077:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383313.474078:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474082:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474109:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b301 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474118:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b301 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.474122:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383313.474123:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383313.474125:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98e00, rc 0) 00000100:00100000:3.0:1787383313.474178:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:11320:x1874206962811136:12345-192.168.202.19@tcp:101:bash.0 Request processed in 591us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383313.474194:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:3.0:1787383313.476425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.476549:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811392 00000100:00100000:2.0:1787383313.476558:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811392 00000100:00100000:2.0:1787383313.476674:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:2.0:1787383313.476685:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+15:11320:x1874206962811392:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383313.476703:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383313.476722:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf450 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b308 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476851:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476864:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476926:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476984:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476991:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.476997:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383313.477558:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787383313.477719:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477729:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477736:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477766:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477772:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477778:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477783:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.477793:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477800:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477812:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383313.477815:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.477818:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477824:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf457 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383313.477835:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df04f344 reply state 00000000d24e54d6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383313.477843:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787383313.477901:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf450 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477916:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.477924:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383313.477926:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383313.477928:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515000, rc 0) 00000100:00100000:2.0:1787383313.478008:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11320:x1874206962811392:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1324us (1588us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787383313.478016:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00010000:00010000:1.0:1787383313.479917:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479932:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479939:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479944:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383313.479948:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479966:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479980:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5300) 00010000:00010000:1.0:1787383313.479982:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383313.479986:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.479991:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf45e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.481259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.481351:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811520 00000100:00100000:1.0:1787383313.481362:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811520 00000100:00100000:1.0:1787383313.481446:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1787383313.481457:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962811520:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383313.481486:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.481568:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b30f expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383313.481597:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383313.481616:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1787383313.481621:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.481630:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.481648:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.481674:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383313.481735:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962811520:12345-192.168.202.19@tcp:101:bash.0 Request processed in 280us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.481743:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00080000:2.0:1787383313.482070:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383313.492608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.492653:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811648 00000100:00100000:1.0:1787383313.492665:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811648 00000100:00100000:1.0:1787383313.492776:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1787383313.492786:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:11320:x1874206962811648:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383313.492804:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.492824:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b316 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.492854:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.492862:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.492881:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.492887:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.492919:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.492931:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.492960:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979596032:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383313.493059:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc072346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383313.497073:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6601:1874206979596032:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383313.497123:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.497148:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b400, rc 0) 00000100:00100000:1.0:1787383313.497257:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:11320:x1874206962811648:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4472us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.497266:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:3.0:1787383313.497343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.498777:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962811776 00000100:00100000:1.0:1787383313.498787:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962811776 00010000:00010000:1.0:1787383313.498824:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.498908:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1787383313.498916:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962811776:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383313.498928:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383313.498948:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.498960:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.498999:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cf473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b30f expref: 7 pid: 6599 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.499011:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.499016:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.499033:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.499041:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.499074:0:8310:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.499093:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8310:1874206979596160:192.168.202.19@tcp:105: 00000100:00100000:1.0:1787383313.499162:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc072346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383313.503136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383313.503203:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962812032 00000100:00100000:0.0:1787383313.503213:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962812032 00000100:00100000:0.0:1787383313.503278:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1787383313.503288:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:11320:x1874206962812032:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:0.0:1787383313.503646:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11320:x1874206962812032:12345-192.168.202.19@tcp:35:bash.0 Request processed in 359us (519us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787383313.503653:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1787383313.504852:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8310:1874206979596160:192.168.202.19@tcp:105: 00010000:00010000:1.0:1787383313.504893:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383313.504972:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2348:x1874206962811776:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 6056us (7628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.504982:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1787383313.576034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.576447:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962812288 00000100:00100000:1.0:1787383313.576459:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962812288 00000100:00100000:1.0:1787383313.576607:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:1.0:1787383313.576629:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11330:x1874206962812288:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383313.576653:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.576672:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b31d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383313.576785:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787383313.576928:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf481 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b31d expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.576942:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:1.0:1787383313.576946:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383313.576951:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b31d expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.576964:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383313.577047:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11330:x1874206962812288:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 419us (1022us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787383313.577054:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:1.0:1787383313.579799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383313.579945:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962812544 00000100:00100000:0.0:1787383313.579954:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962812544 00000100:00100000:0.0:1787383313.579997:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1787383313.580005:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11330:x1874206962812544:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383313.580466:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11330:x1874206962812544:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 458us (672us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787383313.580475:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1787383313.640600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.642717:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962812672 00000100:00100000:1.0:1787383313.642732:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962812672 00000100:00100000:1.0:1787383313.642803:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:1.0:1787383313.642812:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11336:x1874206962812672:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383313.642834:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.642853:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b324 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.642948:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.642960:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.642970:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383313.643082:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787383313.643086:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383313.643110:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.643135:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b324 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.643153:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b324 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.643161:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383313.643164:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383313.643168:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ac00, rc 0) 00000100:00100000:1.0:1787383313.643241:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:11336:x1874206962812672:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 428us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.643248:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:3.0:1787383313.646961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.647178:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962812928 00000100:00100000:1.0:1787383313.647189:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962812928 00000100:00100000:1.0:1787383313.647259:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:1.0:1787383313.647269:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:11336:x1874206962812928:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383313.647300:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.647320:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf49d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b32b expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.647415:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.647429:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.647440:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383313.647452:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787383313.647595:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf49d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b32b expref: 24 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.647612:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b32b expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.647619:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383313.647622:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383313.647625:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b600, rc 0) 00000100:00100000:1.0:1787383313.647684:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:11336:x1874206962812928:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 417us (733us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787383313.647690:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:3.0:1787383313.650589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.654015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.654106:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813312 00000100:00100000:1.0:1787383313.654117:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813312 00000100:00100000:1.0:1787383313.654176:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1787383313.654185:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:2349:x1874206962813312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383313.654201:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383313.654225:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b32b expref: 23 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.654241:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383313.654246:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383313.654308:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:2349:x1874206962813312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.654316:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383313.655169:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813184 00000100:00100000:2.0:1787383313.655178:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813184 00000100:00100000:2.0:1787383313.655221:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:2.0:1787383313.655229:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:11336:x1874206962813184:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383313.655253:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383313.655270:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b332 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.655355:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.655365:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.655372:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383313.655381:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787383313.655494:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b332 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.655510:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b332 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.655529:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383313.655532:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787383313.655535:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515c00, rc 0) 00000100:00100000:2.0:1787383313.655566:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11336:x1874206962813184:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 340us (4988us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787383313.655582:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:3.0:1787383313.662360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.662410:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813440 00000100:00100000:1.0:1787383313.662421:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813440 00000100:00100000:1.0:1787383313.662574:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1787383313.662584:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2350:x1874206962813440:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:1.0:1787383313.662627:0:11924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.662646:0:11924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.662654:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383313.662657:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383313.662661:0:11924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.662712:0:11924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.662723:0:11924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 6 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.662737:0:11924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11924:1874206979596288:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383313.662820:0:11924:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc012ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383313.666951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.667044:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813568 00000100:00100000:2.0:1787383313.667053:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813568 00002000:00100000:2.0:1787383313.667099:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ffc37f1ad80 x1874206962813568/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:99/0 lens 504/0 e 0 to 0 dl 1787383324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383313.667109:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37f1ad80 with x1874206962813568 ext(0->12) 00010000:00010000:2.0:1787383313.667118:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 7 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.667134:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 7 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383313.667140:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc37f1ad80 00000100:00100000:2.0:1787383313.667169:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1787383313.667176:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962813568:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1787383313.667767:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962813568:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 588us (824us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787383313.667776:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:2.0:1787383313.667783:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ffc37f1ad80 x1874206962813568/t4294967305(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:99/0 lens 504/448 e 0 to 0 dl 1787383324 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383313.667790:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc37f1ad80 with x1874206962813568 ext(0->12) 00010000:00010000:2.0:1787383313.667795:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.667816:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383313.667823:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffc37f1ad80 00000100:00100000:1.0:1787383313.668052:0:11924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11924:1874206979596288:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383313.668073:0:11924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.670925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383313.670993:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813696 00000100:00100000:3.0:1787383313.671000:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813696 00010000:00010000:3.0:1787383313.671036:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.671076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1787383313.671084:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962813696:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383313.671095:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787383313.671113:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787383313.671115:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787383314 00002000:00010000:3.0:1787383313.671116:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787383314 00002000:00010000:3.0:1787383313.671118:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787383314 00010000:00010000:3.0:1787383313.671122:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.671131:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.671166:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f0fc79/0x42020b050d5cf47a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b316 expref: 9 pid: 6601 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.671178:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383313.671181:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383313.671186:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.671192:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383313.671216:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383313.671250:0:11924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671260:0:11924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383313.671273:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962813696:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383313.671281:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:0.0:1787383313.671684:0:11924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671696:0:11924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671705:0:11924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671712:0:11924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383313.671716:0:11924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671724:0:11924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671737:0:11924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383313.671757:0:11924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cf4c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383313.672685:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2350:x1874206962813440:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 10095us (10324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383313.672696:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1787383313.674244:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979596416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383313.674321:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383313.674559:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979596416 00000100:00100000:2.0:1787383313.674567:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979596416 00000100:00100000:2.0:1787383313.674614:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787383313.674622:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979596416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383313.674658:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383313.674705:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979596416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.674712:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383313.674787:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979596416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383313.676583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.676710:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962813952 00000100:00100000:2.0:1787383313.676718:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962813952 00000100:00100000:2.0:1787383313.676769:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1787383313.676778:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11336:x1874206962813952:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1787383313.676844:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b332 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383313.677170:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787383313.677213:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787383313.678285:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787383313.678353:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.678372:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.678401:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.678438:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.678453:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 28 pid: 5804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383313.678477:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1874206979596544:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383313.678566:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787383313.682266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.682407:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1874206979596544:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383313.682421:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962814080 00000100:00100000:1.0:1787383313.682428:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962814080 00010000:00010000:2.0:1787383313.682434:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682462:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 29 pid: 5804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.682498:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1787383313.682508:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:2349:x1874206962814080:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383313.682547:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383313.682555:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 29 pid: 5804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682568:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 29 pid: 5804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682590:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b308 expref: 29 pid: 5804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682607:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383313.682612:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682623:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682630:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.682650:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383313.682708:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:2349:x1874206962814080:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 201us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.682715:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00010000:00010000:2.0:1787383313.683072:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.683080:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383313.683208:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787383313.683811:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787383313.684550:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1874206979596672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383313.684606:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383313.684637:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383313.684908:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979596672 00000100:00100000:1.0:1787383313.684915:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979596672 00000100:00100000:1.0:1787383313.684952:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383313.684962:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1874206979596672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383313.685038:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1874206979596672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.685056:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1874206979596672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383313.685057:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00080000:2.0:1787383313.685665:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787383313.685723:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1874206979596800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383313.685752:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383313.685778:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383313.685960:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979596800 00000100:00100000:1.0:1787383313.685964:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979596800 00000100:00100000:1.0:1787383313.685991:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383313.685999:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1874206979596800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383313.686238:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1874206979596800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 238us (483us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787383313.686245:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383313.686267:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d629500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1874206979596800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787383313.686573:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787383313.686607:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686617:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686624:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686629:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.686633:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686639:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686653:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383313.686655:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787383313.686659:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.686664:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf4ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383313.686812:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787383313.686947:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787383313.686958:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337901088953ns, next at 338901086910ns, rc = 0 00000001:00080000:2.0:1787383313.686964:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787383313.686993:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383313.686995:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787383313.687002:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b332 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383313.687154:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:11336:x1874206962813952:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 10376us (10578us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787383313.687162:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000020:00080000:2.0:1787383313.687166:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787383313.691783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.692433:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962814208 00000100:00100000:1.0:1787383313.692443:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962814208 00000100:00100000:1.0:1787383313.692681:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:1.0:1787383313.692692:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:11336:x1874206962814208:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383313.692714:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.692735:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b339 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.692788:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b339 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.692801:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b339 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.692817:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383313.692820:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383313.692823:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b600, rc 0) 00000100:00100000:1.0:1787383313.692894:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11336:x1874206962814208:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 204us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.692913:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:0.0:1787383313.697334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.697435:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962814464 00000100:00100000:1.0:1787383313.697445:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962814464 00000100:00100000:1.0:1787383313.697547:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1787383313.697557:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11336:x1874206962814464:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1787383313.697779:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:11336:x1874206962814464:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 223us (455us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787383313.697787:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1787383313.793117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.793209:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962814720 00000100:00100000:1.0:1787383313.793219:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962814720 00000100:00100000:1.0:1787383313.793284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:1.0:1787383313.793296:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+33:11346:x1874206962814720:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383313.793319:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383313.793339:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b340 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383313.793458:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787383313.793594:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf4dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b340 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.793616:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:1.0:1787383313.793619:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383313.793624:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b340 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.793640:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383313.793715:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11346:x1874206962814720:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 422us (609us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787383313.793721:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:3.0:1787383313.797156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.797250:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962814848 00000100:00100000:1.0:1787383313.797280:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962814848 00000100:00100000:1.0:1787383313.797345:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:1.0:1787383313.797356:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11346:x1874206962814848:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1787383313.797440:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797458:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797472:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797488:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797495:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797501:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797610:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797618:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797624:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383313.797676:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797688:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797693:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797698:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797703:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383313.797707:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797713:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797724:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383313.797726:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383313.797730:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797735:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf4ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797745:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797749:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797759:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797763:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383313.797765:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797769:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797776:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc01425c00) 00010000:00010000:1.0:1787383313.797778:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383313.797780:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797785:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf4f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797799:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797804:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797809:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797813:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383313.797815:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797827:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797833:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383313.797835:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383313.797837:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.797842:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf4f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.797939:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11346:x1874206962814848:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 585us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.797947:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:0.0:1787383313.801046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.801299:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962815104 00000100:00100000:2.0:1787383313.801309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962815104 00000100:00100000:2.0:1787383313.801368:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1787383313.801378:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11346:x1874206962815104:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383313.801614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:11346:x1874206962815104:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 237us (576us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787383313.801621:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1787383313.833625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.833738:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962815360 00000100:00100000:2.0:1787383313.833747:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962815360 00000100:00100000:2.0:1787383313.833850:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:2.0:1787383313.833860:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:11349:x1874206962815360:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383313.833907:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383313.833929:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b347 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834028:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834040:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834050:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834062:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834068:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834073:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834200:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834207:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834213:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383313.834222:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787383313.834327:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834334:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834345:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834350:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.834354:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834361:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834372:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383313.834374:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.834378:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834383:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834397:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834402:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834407:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834411:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383313.834413:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834425:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834432:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383313.834434:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383313.834436:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834441:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf50d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834488:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf4ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834499:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383313.834505:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383313.834507:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383313.834509:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383313.834578:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11349:x1874206962815360:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 719us (963us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787383313.834585:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:3.0:1787383313.837940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383313.838582:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962815488 00000100:00100000:1.0:1787383313.838592:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962815488 00000100:00100000:1.0:1787383313.838689:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:1.0:1787383313.838699:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11349:x1874206962815488:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383313.838768:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838783:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838795:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838819:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838843:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838850:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838855:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383313.838860:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838895:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838907:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383313.838910:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383313.838914:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383313.838920:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383313.838993:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11349:x1874206962815488:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 296us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.839000:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:0.0:1787383313.841884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383313.841932:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962815744 00000100:00100000:2.0:1787383313.841943:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962815744 00000100:00100000:2.0:1787383313.842004:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1787383313.842015:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11349:x1874206962815744:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383313.842261:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:11349:x1874206962815744:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 247us (403us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787383313.842269:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1787383314.056608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.056720:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962816000 00000100:00100000:1.0:1787383314.056729:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962816000 00000100:00100000:1.0:1787383314.056831:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:1.0:1787383314.056841:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:11380:x1874206962816000:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:1.0:1787383314.056894:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383314.056925:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b34e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.057023:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.057034:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.057044:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383314.057054:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787383314.057192:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b34e expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.057208:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b34e expref: 40 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.057216:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.057219:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383314.057222:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6be00, rc 0) 00000100:00100000:1.0:1787383314.057281:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11380:x1874206962816000:12345-192.168.202.19@tcp:101:cat.0 Request processed in 440us (682us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787383314.057288:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:2.0:1787383314.061629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.061687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383314.061713:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962816128 00000100:00100000:3.0:1787383314.061724:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962816128 00000100:00100000:1.0:1787383314.061759:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962816384 00000100:00100000:1.0:1787383314.061763:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962816384 00000100:00100000:3.0:1787383314.061797:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1787383314.061807:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:2351:x1874206962816128:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383314.061822:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787383314.061830:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1787383314.061837:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:11380:x1874206962816384:12345-192.168.202.19@tcp:35:cat.0 00010000:00010000:3.0:1787383314.061847:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b34e expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.061892:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383314.061897:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383314.061948:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:2351:x1874206962816128:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 143us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383314.061955:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1787383314.062059:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11380:x1874206962816384:12345-192.168.202.19@tcp:35:cat.0 Request processed in 222us (371us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787383314.062065:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1787383314.113027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383314.113108:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962816640 00000100:00100000:3.0:1787383314.113118:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962816640 00000100:00100000:3.0:1787383314.113178:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:3.0:1787383314.113187:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11386:x1874206962816640:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1787383314.113210:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383314.113213:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787383314.113238:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b324 expref: 40 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113256:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383314.113262:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383314.113275:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf53e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b355 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113374:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113386:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113393:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113435:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.113446:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 40 pid: 5804 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383314.113459:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c93e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979596928:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383314.113562:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383314.115928:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c93e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979596928:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383314.115953:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383314.116608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.116685:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962816768 00000100:00100000:2.0:1787383314.116693:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962816768 00010000:00010000:2.0:1787383314.116726:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 41 pid: 5804 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.116758:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1787383314.116766:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+41:2349:x1874206962816768:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383314.116778:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383314.116783:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 41 pid: 5804 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116793:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 41 pid: 5804 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116812:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b347 expref: 41 pid: 5804 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116826:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383314.116831:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116839:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116860:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.116910:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383314.116961:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:2349:x1874206962816768:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 195us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383314.116968:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00010000:00010000:3.0:1787383314.117032:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.117040:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383314.117057:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787383314.117200:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf53e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.117213:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.117220:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383314.117223:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383314.117225:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:3.0:1787383314.117247:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11386:x1874206962816640:12345-192.168.202.19@tcp:101:dd.0 Request processed in 4062us (4231us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787383314.117254:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:3.0:1787383314.119967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.120185:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817024 00000100:00100000:2.0:1787383314.120194:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817024 00000100:00100000:2.0:1787383314.120310:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:2.0:1787383314.120321:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11386:x1874206962817024:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1787383314.120612:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.120629:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.120640:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383314.120686:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787383314.120706:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017675865 reply state 000000009cd997fc transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.120713:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383314.120839:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:11386:x1874206962817024:12345-192.168.202.19@tcp:36:dd.0 Request processed in 520us (880us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787383314.120846:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 155 00000020:00080000:2.0:1787383314.120851:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787383314.125408:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125426:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125434:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125440:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383314.125445:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125452:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125470:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383314.125473:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383314.125477:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.125482:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf553 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.250484:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383314.384813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.385049:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817152 00000100:00100000:1.0:1787383314.385060:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817152 00000100:00100000:1.0:1787383314.385118:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:1.0:1787383314.385128:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:11400:x1874206962817152:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:1.0:1787383314.385154:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383314.385175:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf55a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b35c expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385260:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385284:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385296:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385310:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385317:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385333:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385422:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385432:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385441:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385470:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.385482:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 43 pid: 5805 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383314.385495:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979597056:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383314.385673:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc03438b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383314.387845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.387889:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817408 00000100:00100000:2.0:1787383314.387899:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817408 00000100:00100000:2.0:1787383314.387962:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1787383314.387970:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979597056:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383314.387971:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:5561:x1874206962817408:12345-192.168.202.19@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1787383314.387995:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.388314:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:5561:x1874206962817408:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 343us (473us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787383314.388321:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1787383314.391332:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383314.391431:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817536 00000100:00100000:3.0:1787383314.391442:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817536 00010000:00010000:3.0:1787383314.391480:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 45 pid: 5805 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383314.391523:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1787383314.391540:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:2348:x1874206962817536:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383314.391551:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383314.391556:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 45 pid: 5805 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391566:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 45 pid: 5805 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391583:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf545 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b355 expref: 45 pid: 5805 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391595:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383314.391599:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391606:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391610:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.391633:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383314.391703:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:2348:x1874206962817536:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 161us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383314.391710:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00010000:00010000:1.0:1787383314.391744:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391753:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383314.391808:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787383314.391812:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383314.391835:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391846:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391855:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391861:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391898:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391905:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383314.391909:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391916:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391925:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383314.391928:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383314.391932:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391938:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf561 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391959:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391965:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391971:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391976:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383314.391979:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391984:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.391991:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc01425c00) 00010000:00010000:1.0:1787383314.391993:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383314.391996:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.392001:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.392050:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf55a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b35c expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.392061:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b35c expref: 43 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.392078:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.392080:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383314.392083:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ba00, rc 0) 00000100:00100000:1.0:1787383314.392117:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:11400:x1874206962817152:12345-192.168.202.19@tcp:101:stat.0 Request processed in 6991us (7315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383314.392125:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:0.0:1787383314.498131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.498310:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817792 00000100:00100000:1.0:1787383314.498320:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817792 00000100:00100000:1.0:1787383314.498377:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 157 00000100:00100000:1.0:1787383314.498386:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:11406:x1874206962817792:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:1.0:1787383314.498447:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383314.498476:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf56f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b35c expref: 43 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.498496:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.498502:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383314.498719:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.498732:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.498741:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383314.498791:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787383314.498814:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfe49539 reply state 0000000063636aa5 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383314.498839:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383314.498991:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:11406:x1874206962817792:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 605us (868us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787383314.499000:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 157 00000020:00080000:1.0:1787383314.499005:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787383314.502023:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502040:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502047:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502052:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383314.502057:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502063:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502085:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.502088:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383314.502091:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.502097:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf576 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383314.781283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383314.781599:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962817920 00000100:00100000:3.0:1787383314.781608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962817920 00000100:00100000:3.0:1787383314.781660:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:3.0:1787383314.781670:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:11420:x1874206962817920:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:3.0:1787383314.781699:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383314.781719:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf57d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b363 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781791:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781806:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781816:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781829:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781835:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.781841:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786782:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786801:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786813:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383314.786855:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787383314.786883:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383314.786906:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786917:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786925:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786930:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786936:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786941:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383314.786945:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786952:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786963:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383314.786966:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383314.786969:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786975:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.786987:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787000:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787005:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787009:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383314.787012:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787019:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787026:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383314.787029:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383314.787031:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787037:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf58b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787076:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf57d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787092:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 45 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383314.787100:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383314.787102:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383314.787110:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383314.788411:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:11420:x1874206962817920:12345-192.168.202.19@tcp:101:stat.0 Request processed in 6733us (7130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383314.788422:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 158 00000001:00080000:3.0:1787383314.800060:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787383314.800084:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1787383314.879049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.879202:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962818176 00000100:00100000:1.0:1787383314.879225:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962818176 00000100:00100000:1.0:1787383314.879298:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:1.0:1787383314.879307:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+45:11430:x1874206962818176:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383314.879331:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383314.879351:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b36a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383314.879472:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787383314.879736:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf599 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b36a expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.879750:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:1.0:1787383314.879753:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383314.879757:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b36a expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.879770:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a000, rc 0) 00000100:00100000:1.0:1787383314.879971:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:11430:x1874206962818176:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 664us (933us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787383314.879978:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:3.0:1787383314.883062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.883273:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962818432 00000100:00100000:1.0:1787383314.883282:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962818432 00000100:00100000:1.0:1787383314.883382:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1787383314.883393:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+46:11430:x1874206962818432:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1787383314.883651:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:11430:x1874206962818432:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 259us (599us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787383314.883658:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1787383314.961838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.962067:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962818688 00000100:00100000:2.0:1787383314.962084:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962818688 00000100:00100000:2.0:1787383314.962137:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:2.0:1787383314.962146:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+47:11436:x1874206962818688:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383314.962170:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383314.962191:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b371 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.962300:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.962313:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.962323:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.962353:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.962365:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 48 pid: 5805 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.962387:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979597184:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383314.962467:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383314.967540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.967640:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962818816 00000100:00100000:1.0:1787383314.967650:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962818816 00010000:00010000:1.0:1787383314.967689:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 49 pid: 5805 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383314.967732:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1787383314.967740:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:2348:x1874206962818816:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383314.967754:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383314.967760:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 49 pid: 5805 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.967773:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 49 pid: 5805 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.967794:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.967798:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.967807:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.967814:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.967832:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383314.967917:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+49:2348:x1874206962818816:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 177us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383314.967924:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00010000:00010000:2.0:1787383314.968739:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b363 expref: 48 pid: 5805 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.968758:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979597184:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383314.968779:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.968788:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.968793:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383314.968812:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787383314.969023:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 49 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.969041:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 48 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.969049:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383314.969052:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383314.969055:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514c00, rc 0) 00000100:00100000:2.0:1787383314.969161:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:11436:x1874206962818688:12345-192.168.202.19@tcp:101:bash.0 Request processed in 7015us (7331us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787383314.969178:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:3.0:1787383314.973619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.973731:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819072 00000100:00100000:2.0:1787383314.973740:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819072 00000100:00100000:2.0:1787383314.973794:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:2.0:1787383314.973801:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:11436:x1874206962819072:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1787383314.974089:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.974103:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.974114:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383314.974157:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787383314.974180:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c191e79 reply state 00000000ee228f5b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.974189:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383314.974288:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:11436:x1874206962819072:12345-192.168.202.19@tcp:36:bash.0 Request processed in 486us (676us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787383314.974296:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 161 00000020:00080000:2.0:1787383314.974301:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787383314.978427:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978445:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978453:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978472:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383314.978477:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978485:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978511:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383314.978515:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383314.978519:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.978525:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383314.983062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383314.983284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819200 00000100:00100000:1.0:1787383314.983294:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819200 00000100:00100000:1.0:1787383314.983350:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:1.0:1787383314.983358:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:11436:x1874206962819200:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383314.983381:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383314.983410:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf5c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b378 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.983487:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.983532:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.983542:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.983575:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.983588:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 51 pid: 8068 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383314.983601:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979597312:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383314.983679:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383314.988158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.988314:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819328 00000100:00100000:2.0:1787383314.988324:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819328 00010000:00010000:2.0:1787383314.988363:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 52 pid: 8068 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383314.988416:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1787383314.988426:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:2349:x1874206962819328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383314.988441:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383314.988449:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 52 pid: 8068 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.988462:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 52 pid: 8068 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.988516:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383314.988522:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.988532:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.988540:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383314.988560:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383314.988618:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:2349:x1874206962819328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 193us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383314.988626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00010000:00010000:1.0:1787383314.988984:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf5ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b371 expref: 51 pid: 8068 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383314.989001:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979597312:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383314.989029:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.989037:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.989042:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383314.989096:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787383314.989100:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383314.989119:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.989146:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf5c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b378 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.989158:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b378 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383314.989166:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383314.989169:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383314.989171:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b200, rc 0) 00000100:00100000:1.0:1787383314.989195:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:11436:x1874206962819200:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5839us (6143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383314.989201:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:0.0:1787383314.993125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383314.993285:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819584 00000100:00100000:2.0:1787383314.993296:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819584 00000100:00100000:2.0:1787383314.993351:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1787383314.993361:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:11436:x1874206962819584:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1787383314.993629:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:11436:x1874206962819584:12345-192.168.202.19@tcp:35:bash.0 Request processed in 268us (512us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787383314.993637:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1787383315.087836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.087963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819840 00000100:00100000:2.0:1787383315.087973:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819840 00000100:00100000:2.0:1787383315.088047:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:2.0:1787383315.088057:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:11446:x1874206962819840:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383315.088089:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383315.088121:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b37f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383315.088244:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787383315.088373:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b37f expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.088387:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:2.0:1787383315.088390:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383315.088394:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b37f expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.088408:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383315.088467:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11446:x1874206962819840:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 412us (643us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787383315.088475:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00080000:1.0:1787383315.088990:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383315.092420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.092556:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962819968 00000100:00100000:2.0:1787383315.092566:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962819968 00000100:00100000:2.0:1787383315.092621:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1787383315.092629:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11446:x1874206962819968:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1787383315.092701:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092716:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092727:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092755:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092761:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092767:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092857:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092865:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092912:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383315.092949:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092960:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092965:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092970:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092976:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383315.092979:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.092991:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093003:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383315.093005:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383315.093009:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093014:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf5df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093026:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093031:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093036:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093040:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383315.093042:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093047:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093052:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383315.093054:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383315.093056:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093068:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093092:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093097:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093102:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093106:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383315.093109:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093114:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093121:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383315.093122:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383315.093125:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.093130:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383315.093437:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11446:x1874206962819968:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 808us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.093445:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:3.0:1787383315.095849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.095926:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962820224 00000100:00100000:2.0:1787383315.095934:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962820224 00000100:00100000:2.0:1787383315.095984:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1787383315.095992:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11446:x1874206962820224:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383315.096573:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+53:11446:x1874206962820224:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 578us (729us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787383315.096581:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:3.0:1787383315.134118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.134283:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962820480 00000100:00100000:2.0:1787383315.134293:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962820480 00000100:00100000:2.0:1787383315.134352:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:2.0:1787383315.134361:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+53:11449:x1874206962820480:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383315.134386:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383315.134407:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b386 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134494:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134518:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134529:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134545:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134552:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134584:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134716:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134726:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134734:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383315.134744:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787383315.134833:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134839:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134845:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134850:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383315.134853:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134860:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134910:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383315.134913:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383315.134924:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134930:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf5fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134943:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134948:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134953:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134957:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383315.134959:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134964:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134970:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383315.134972:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383315.134974:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.134979:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.135013:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf5f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b386 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.135035:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b386 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.135041:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383315.135043:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383315.135045:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383315.135564:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11449:x1874206962820480:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1202us (1454us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787383315.135572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:0.0:1787383315.141640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383315.141722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.141821:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962820608 00000100:00100000:1.0:1787383315.141831:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962820608 00000100:00100000:1.0:1787383315.141909:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1787383315.141930:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11449:x1874206962820608:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383315.141996:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142021:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142032:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142055:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142061:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142066:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142071:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383315.142215:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142224:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142235:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383315.142237:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383315.142241:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.142247:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383315.142334:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11449:x1874206962820608:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 405us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.142341:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1787383315.144626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.144792:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962820736 00000100:00100000:2.0:1787383315.144800:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962820736 00000100:00100000:2.0:1787383315.144894:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383315.144904:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:2350:x1874206962820736:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383315.144917:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383315.144937:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b386 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.144953:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383315.144957:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383315.144993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:2350:x1874206962820736:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 92us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.144999:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383315.146046:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962820992 00000100:00100000:3.0:1787383315.146055:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962820992 00000100:00100000:3.0:1787383315.146149:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1787383315.146159:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:11449:x1874206962820992:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1787383315.146381:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11449:x1874206962820992:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 222us (1759us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787383315.146389:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00010000:00010000:2.0:1787383315.274055:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383315.328941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383315.329053:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962821248 00000100:00100000:3.0:1787383315.329065:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962821248 00000100:00100000:3.0:1787383315.329136:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:3.0:1787383315.329147:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11467:x1874206962821248:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:3.0:1787383315.329183:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383315.329204:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf61e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b38d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.329321:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.329336:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.329348:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383315.329360:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787383315.329728:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf61e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b38d expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.329749:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b38d expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.329757:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:3.0:1787383315.329760:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787383315.329763:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383315.329817:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11467:x1874206962821248:12345-192.168.202.19@tcp:101:cat.0 Request processed in 671us (886us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787383315.329825:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:3.0:1787383315.370415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.370909:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962821376 00000100:00100000:2.0:1787383315.370920:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962821376 00000100:00100000:2.0:1787383315.370997:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:2.0:1787383315.371019:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11468:x1874206962821376:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383315.371044:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383315.371188:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b394 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371262:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371291:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371303:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383315.371366:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787383315.371370:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383315.371391:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371419:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b394 expref: 59 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371437:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b394 expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.371446:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383315.372167:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383315.372174:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515000, rc 0) 00000100:00100000:2.0:1787383315.372539:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11468:x1874206962821376:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1530us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.372559:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:0.0:1787383315.378698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.378776:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962821760 00000100:00100000:2.0:1787383315.378785:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962821760 00000100:00100000:2.0:1787383315.378843:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1787383315.378853:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11468:x1874206962821760:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383315.379204:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11468:x1874206962821760:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 351us (514us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787383315.379212:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1787383315.382361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.382623:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962821888 00000100:00100000:2.0:1787383315.382632:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962821888 00000100:00100000:2.0:1787383315.382699:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1787383315.382710:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11468:x1874206962821888:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:2.0:1787383315.382725:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787383315.382749:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf5ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b378 expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.382769:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b38d expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.382782:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf4d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b339 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.382791:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383315.382802:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383315.382859:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:11468:x1874206962821888:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 151us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.382920:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1787383315.396861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383315.397038:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822016 00000100:00100000:3.0:1787383315.397048:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822016 00000100:00100000:3.0:1787383315.397178:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:3.0:1787383315.397189:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:11468:x1874206962822016:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:3.0:1787383315.397294:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.397311:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.397322:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383315.398658:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787383315.398769:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:11468:x1874206962822016:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1578us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.398779:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:1.0:1787383315.456133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383315.456232:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822144 00000100:00100000:3.0:1787383315.456242:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822144 00000100:00100000:3.0:1787383315.456315:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:3.0:1787383315.456325:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:11470:x1874206962822144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383315.456347:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383315.456368:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b39b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456434:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456449:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456469:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456525:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456534:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456542:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456641:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456649:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456656:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383315.456692:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787383315.456697:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383315.456715:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456726:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456734:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456741:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456758:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456764:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383315.456768:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456776:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456790:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383315.456793:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383315.456798:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456805:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf64f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456819:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456826:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456832:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456837:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383315.456840:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456856:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456865:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc094fe200) 00010000:00010000:3.0:1787383315.456921:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383315.456924:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456930:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf656 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456965:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456978:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.456985:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383315.456987:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383315.456990:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc00031000, rc 0) 00000100:00100000:3.0:1787383315.457060:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11470:x1874206962822144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 736us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.457068:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000040:00080000:3.0:1787383315.918278:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383315.918289:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383315.918330:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787383315.918337:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383315.918512:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979597440:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383315.919025:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383315.923684:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979597440:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383315.923977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383315.924008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822272 00000100:00100000:3.0:1787383315.924015:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822272 00000100:00100000:3.0:1787383315.924062:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:3.0:1787383315.924071:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11481:x1874206962822272:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787383315.924101:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787383315.924198:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11481:x1874206962822272:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 127us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.924206:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:3.0:1787383315.930596:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.934586:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822400 00000100:00100000:1.0:1787383315.934602:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822400 00000100:00100000:1.0:1787383315.934717:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:1.0:1787383315.934728:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11481:x1874206962822400:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383315.935829:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935850:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935863:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935890:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935897:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935904:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935943:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935952:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.935959:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383315.935994:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787383315.935999:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383315.936011:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936021:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936027:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936033:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936039:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383315.936043:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936050:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936062:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:1.0:1787383315.936070:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383315.936076:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936081:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf664 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936093:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936099:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936105:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936111:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383315.936114:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936120:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936127:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ffc01425700) 00010000:00010000:1.0:1787383315.936130:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383315.936132:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936137:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf66b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936153:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936165:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936170:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936176:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383315.936179:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936185:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936192:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:1.0:1787383315.936195:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383315.936198:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.936202:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf672 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383315.936283:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11481:x1874206962822400:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 1556us (5694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.936292:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:0.0:1787383315.945610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383315.945673:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822656 00000100:00100000:3.0:1787383315.945682:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822656 00000100:00100000:3.0:1787383315.945735:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:3.0:1787383315.945745:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11481:x1874206962822656:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383315.945854:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383315.945898:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf679 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3a2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.945992:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946005:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946017:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383315.946039:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787383315.946127:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946134:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946141:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946148:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383315.946151:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946158:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946170:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383315.946173:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383315.946178:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946183:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946222:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf679 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3a2 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946232:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383315.946235:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383315.946245:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf679 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3a2 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383315.946255:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383315.946320:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962822656:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 575us (717us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787383315.946327:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:1.0:1787383315.959093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.959130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.959154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.959173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.959193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.959229:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823168 00000100:00100000:1.0:1787383315.959239:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823168 00000100:00100000:1.0:1787383315.959288:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823040 00000100:00100000:1.0:1787383315.959291:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823040 00000100:00100000:1.0:1787383315.959325:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1787383315.959336:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962823168:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383315.959405:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2351:x1874206962823168:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.959413:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1787383315.959433:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:1.0:1787383315.959440:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962823040:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383315.959571:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822784 00000100:00100000:2.0:1787383315.959576:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822784 00000100:00100000:2.0:1787383315.959605:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823296 00000100:00100000:2.0:1787383315.959608:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823296 00000100:00100000:2.0:1787383315.959632:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:2.0:1787383315.959639:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962823296:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383315.959670:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2351:x1874206962823296:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.959677:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:2.0:1787383315.959695:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:2.0:1787383315.959702:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962822784:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383315.959725:0:8068:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383315.959814:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962822784:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 112us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.959820:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:1.0:1787383315.962792:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2351:x1874206962823040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 3343us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.962807:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00080000:1.0:1787383315.962850:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383315.962855:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383315.962858:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383315.964349:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962822912 00000100:00100000:3.0:1787383315.964361:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962822912 00000100:00100000:3.0:1787383315.964413:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 295 00000100:00100000:3.0:1787383315.964422:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962822912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383315.964701:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2351:x1874206962822912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 279us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.964709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 295 00000100:00100000:1.0:1787383315.970699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383315.970912:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823552 00000100:00100000:0.0:1787383315.970933:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823552 00000100:00100000:0.0:1787383315.970995:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:0.0:1787383315.971006:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962823552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383315.971028:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383315.971032:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787383315.971059:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf63a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b394 expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971077:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:0.0:1787383315.971082:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383315.971096:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf68e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3a9 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383315.971508:0:8068:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787383315.971708:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf695 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971722:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971732:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971928:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf68e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3a9 expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971945:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3a9 expref: 59 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.971964:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc0a060400) 00010000:00010000:0.0:1787383315.971967:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383315.971970:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047400, rc 0) 00000100:00100000:0.0:1787383315.972031:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11481:x1874206962823552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1027us (1342us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787383315.972039:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:0.0:1787383315.981330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383315.981363:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823808 00000100:00100000:0.0:1787383315.981372:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823808 00000100:00100000:0.0:1787383315.981418:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:0.0:1787383315.981427:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11481:x1874206962823808:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383315.981504:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383315.981533:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf695 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3a9 expref: 59 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981551:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc0a060400) 00010000:00010000:0.0:1787383315.981563:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383315.981586:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981599:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981609:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981622:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981638:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981645:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981717:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981724:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981730:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981736:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383315.981740:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981747:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981756:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:0.0:1787383315.981770:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383315.981774:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981780:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981788:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981800:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981805:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981810:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383315.981813:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981819:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981826:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xffadff10 (ffff9ffc0a060a00) 00010000:00010000:0.0:1787383315.981829:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383315.981831:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383315.981837:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xffadff10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383315.981927:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962823808:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 501us (603us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383315.981934:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:0.0:1787383315.986233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383315.986323:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962823936 00000100:00100000:2.0:1787383315.986334:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962823936 00000100:00100000:2.0:1787383315.986397:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:2.0:1787383315.986408:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11481:x1874206962823936:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383315.986429:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383315.986537:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf6b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3b0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986575:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986598:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986610:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986706:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf6b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986722:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 59 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383315.986730:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383315.986733:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383315.986737:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515a00, rc 0) 00000100:00100000:2.0:1787383315.986896:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11481:x1874206962823936:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 490us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.986903:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:0.0:1787383315.992051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383315.992120:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962824192 00000100:00100000:1.0:1787383315.992130:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962824192 00000100:00100000:1.0:1787383315.992187:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:1.0:1787383315.992199:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11481:x1874206962824192:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383315.992287:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.992304:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.992327:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383315.992659:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787383315.992670:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340206801253ns, next at 341206799044ns, rc = 0 00000004:00010000:1.0:1787383315.992752:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0819ca9 reply state 0000000079de7a1d transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383315.992773:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383315.992892:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11481:x1874206962824192:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 672us (826us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787383315.992899:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 178 00010000:00010000:1.0:1787383315.997479:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997522:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997529:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997537:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383315.997542:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997549:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997567:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383315.997570:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787383315.997583:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383315.997589:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf6bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.003187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.003574:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962824320 00000100:00100000:0.0:1787383316.003584:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962824320 00000100:00100000:0.0:1787383316.003673:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:0.0:1787383316.003691:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11481:x1874206962824320:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383316.003715:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383316.003735:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3b7 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.003804:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.003820:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.003841:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:0.0:1787383316.003844:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383316.003848:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383316.003940:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11481:x1874206962824320:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 252us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383316.003949:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:1.0:1787383316.009608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383316.009712:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962824448 00000100:00100000:3.0:1787383316.009723:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962824448 00000100:00100000:3.0:1787383316.009788:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1787383316.009799:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962824448:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787383316.010260:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962824448:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 461us (660us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787383316.010270:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1787383316.012859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.013001:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962824704 00000100:00100000:0.0:1787383316.013010:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962824704 00000100:00100000:0.0:1787383316.013060:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1787383316.013082:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11481:x1874206962824704:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787383316.013311:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11481:x1874206962824704:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 231us (459us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787383316.013319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:3.0:1787383316.019459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.019603:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962824960 00000100:00100000:0.0:1787383316.019613:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962824960 00000100:00100000:0.0:1787383316.019675:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:0.0:1787383316.019685:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11481:x1874206962824960:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787383316.019800:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11481:x1874206962824960:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383316.019807:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:1.0:1787383316.033312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383316.033383:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825088 00000100:00100000:3.0:1787383316.033393:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825088 00000100:00100000:3.0:1787383316.033453:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:3.0:1787383316.033464:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11481:x1874206962825088:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383316.033503:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383316.033522:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf6cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3be expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033595:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033610:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033621:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383316.033658:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383316.033674:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033699:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf6cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3be expref: 64 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033716:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3be expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.033725:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:3.0:1787383316.033728:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383316.033731:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383316.034085:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+63:11481:x1874206962825088:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 621us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383316.034093:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:3.0:1787383316.040231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.040463:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825216 00000100:00100000:1.0:1787383316.040473:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825216 00000100:00100000:1.0:1787383316.040527:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1787383316.040538:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962825216:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383316.040555:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383316.040577:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3c5 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383316.040603:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e14, blocks: 0x1 00010000:00010000:1.0:1787383316.040622:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1787383316.040627:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.040637:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.040655:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.040670:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a000, rc 0) 00000100:00100000:1.0:1787383316.040735:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962825216:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 200us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.040750:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1787383316.049125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.049266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825472 00000100:00100000:1.0:1787383316.049276:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825472 00000100:00100000:1.0:1787383316.049378:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:1.0:1787383316.049391:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+63:11481:x1874206962825472:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787383316.049524:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+63:11481:x1874206962825472:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.049533:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:3.0:1787383316.054225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.054306:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825600 00000100:00100000:1.0:1787383316.054316:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825600 00000100:00100000:1.0:1787383316.054370:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1787383316.054379:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:11481:x1874206962825600:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383316.054397:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383316.054417:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3cc expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.054465:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.054474:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.054477:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.054482:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.054526:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.054553:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.054568:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979597568:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383316.054964:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383316.057359:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979597568:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383316.057395:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.057417:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ba00, rc 0) 00000100:00100000:1.0:1787383316.057532:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:11481:x1874206962825600:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 3153us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.057541:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1787383316.059281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.059352:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825728 00000100:00100000:1.0:1787383316.059361:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825728 00010000:00010000:1.0:1787383316.059397:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.059439:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1787383316.059458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962825728:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383316.059471:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383316.059513:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.059549:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.059576:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000967eb7b4/0x42020b050d5cf6db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3c5 expref: 9 pid: 6601 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.059592:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.059596:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.059604:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.059615:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.059656:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.059671:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979597696:192.168.202.19@tcp:105: 00000100:00100000:1.0:1787383316.059737:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc37f02c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383316.062709:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c951180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979597696:192.168.202.19@tcp:105: 00010000:00010000:1.0:1787383316.062737:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383316.062802:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962825728:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 3354us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.062812:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1787383316.064671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.064776:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825856 00000100:00100000:0.0:1787383316.064785:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825856 00002000:00100000:0.0:1787383316.064835:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ffc2d21a300 x1874206962825856/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:102/0 lens 504/0 e 0 to 0 dl 1787383327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383316.064846:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21a300 with x1874206962825856 ext(0->8) 00002000:00010000:0.0:1787383316.064852:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21a300 00000100:00100000:0.0:1787383316.064900:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1787383316.064910:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962825856:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787383316.065370:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2349:x1874206962825856:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 459us (703us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787383316.065378:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00002000:00100000:0.0:1787383316.065385:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ffc2d21a300 x1874206962825856/t4294967314(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:102/0 lens 504/448 e 0 to 0 dl 1787383327 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383316.065393:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc2d21a300 with x1874206962825856 ext(0->8) 00002000:00010000:0.0:1787383316.065397:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc2d21a300 00000100:00100000:0.0:1787383316.070727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383316.070859:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962825984 00000100:00100000:2.0:1787383316.070901:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962825984 00000100:00100000:2.0:1787383316.070959:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:2.0:1787383316.070970:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+63:11481:x1874206962825984:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787383316.108285:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787383316.108314:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787383316.108393:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787383316.108411:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc2fcf7d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787383316.108416:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc2d1b0200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc2fcf7900 00000020:00080000:3.0:1787383316.108419:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc2d1b0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc3c5ce800 00000100:00100000:1.0:1787383316.109015:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979597824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787383316.109151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787383316.109283:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787383316.109441:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787383316.109468:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979597952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787383316.109509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383316.109552:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979597824 00000100:00100000:3.0:1787383316.109560:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979597824 00000100:00100000:3.0:1787383316.109608:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979597952 00000100:00100000:3.0:1787383316.109611:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979597952 00000100:00100000:3.0:1787383316.109634:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383316.109643:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979597824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787383316.109862:0:6601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787383316.109865:0:6601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787383316 00002000:00010000:3.0:1787383316.109887:0:6601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787383316.109890:0:6601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787383316 -> 1787383316 00002000:00010000:3.0:1787383316.109892:0:6601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787383316.110902:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383316.110922:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979597952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787383316.110945:0:11924:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787383316.110976:0:11924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a894e12, atime: 0x6a894e12, ctime: 0x6a894e12, blocks: 0xb 00010000:00010000:0.0:1787383316.110984:0:11924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.110998:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1787383316.111003:0:11924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383316.111009:0:11924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.111023:0:11924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.111031:0:11924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.111039:0:11924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.111059:0:11924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787383316.111573:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979597952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 653us (2061us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787383316.111580:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1787383316.112982:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383316.112992:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.113015:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383316.113020:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.113030:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.113049:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.113065:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf6e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.113086:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383316.113088:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383316.113089:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383316.120476:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979597824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 10824us (11315us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787383316.120518:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787383316.120552:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383316.120565:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383316.120616:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787383316.120622:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787383316.120647:0:3314:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffb029ace00 x1874206979597952/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383332 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787383316.120661:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffb029ace00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787383316.120666:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979597952:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787383316.120899:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffb029adf80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787383316.120906:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979597824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787383316.121846:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11481:x1874206962825984:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 50871us (51121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383316.121856:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:3.0:1787383316.135950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383316.135987:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962826112 00000100:00100000:3.0:1787383316.137855:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962826112 00000100:00100000:3.0:1787383316.137939:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:3.0:1787383316.137949:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2348:x1874206962826112:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787383316.185897:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2348:x1874206962826112:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 47939us (49946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.185910:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000001:00080000:1.0:1787383316.185952:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787383316.185965:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787383316.209255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.210654:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962826368 00000100:00100000:0.0:1787383316.210667:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962826368 00000100:00100000:0.0:1787383316.210774:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:0.0:1787383316.210785:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11481:x1874206962826368:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383316.210843:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383316.210892:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf6d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3be expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.210910:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:0.0:1787383316.210920:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383316.210953:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.210967:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.210977:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383316.211213:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005848364a reply state 00000000f8fcb1f8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383316.211224:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383316.211328:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11481:x1874206962826368:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 544us (2082us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787383316.211337:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000040:00080000:0.0:1787383316.219451:0:12318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383316.219463:0:12318:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383316.219555:0:12318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787383316.219561:0:12318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383316.220934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1787383316.220961:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.220968:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.220973:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.220978:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383316.220981:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.220987:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.221009:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383316.221011:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383316.221014:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.221027:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cf6f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383316.224718:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962826496 00000100:00100000:0.0:1787383316.224732:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962826496 00000100:00100000:0.0:1787383316.224796:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1787383316.224807:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962826496:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787383316.225046:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787383316.225050:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787383316 -> 1787383315 00002000:00010000:0.0:1787383316.225051:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787383314 00002000:00010000:0.0:1787383316.225053:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787383316 -> 1787383315 00002000:00010000:0.0:1787383316.225055:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787383316.225127:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962826496:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 322us (4199us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787383316.225133:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:3.0:1787383316.228341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.228390:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962826752 00000100:00100000:0.0:1787383316.228399:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962826752 00000100:00100000:0.0:1787383316.228607:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:0.0:1787383316.228619:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:11481:x1874206962826752:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787383316.228694:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.228712:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.228721:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.228754:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.228778:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 18 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383316.228793:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979598080:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383316.228898:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383316.240305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383316.240438:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962826880 00000100:00100000:2.0:1787383316.240447:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962826880 00010000:00010000:2.0:1787383316.240486:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383316.240550:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1787383316.240616:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979598080:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383316.240642:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383316.240659:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2348:x1874206962826880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383316.240675:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383316.240682:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240695:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240714:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf6b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b0 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240726:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:2.0:1787383316.240731:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240740:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240748:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.240774:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383316.240842:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240850:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383316.240859:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:2348:x1874206962826880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 300us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383316.240866:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00010000:00010000:0.0:1787383316.240894:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240901:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240907:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240913:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383316.240917:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240924:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240933:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:0.0:1787383316.240936:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787383316.240940:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.240945:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf6f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383316.240986:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:11481:x1874206962826752:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 12370us (12651us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787383316.240999:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:2.0:1787383316.250191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.250450:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827008 00000100:00100000:1.0:1787383316.250472:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827008 00000100:00100000:1.0:1787383316.250544:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1787383316.250555:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962827008:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787383316.250600:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.250621:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.250630:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383316.250634:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383316.250639:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.250676:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.250691:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.250706:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979598208:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383316.250801:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383316.260771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383316.260989:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827136 00000100:00100000:2.0:1787383316.260999:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827136 00010000:00010000:2.0:1787383316.261038:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 9 pid: 6599 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383316.261090:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1787383316.261099:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962827136:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383316.261114:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383316.261136:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 9 pid: 6599 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.261164:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 9 pid: 6599 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.261194:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383316.261199:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383316.261205:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.261216:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383316.261235:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383316.261287:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962827136:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 188us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383316.261295:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00010000:00010000:1.0:1787383316.261940:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e805f21/0x42020b050d5cf6e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3cc expref: 8 pid: 6599 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.261955:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979598208:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383316.261974:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.261984:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.261991:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262016:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262025:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262033:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262040:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383316.262045:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262067:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262080:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.262088:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f4cc38/0x42020b050d5cf6fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.262145:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962827008:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 11592us (11964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.262153:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:3.0:1787383316.272459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.272607:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827392 00000100:00100000:1.0:1787383316.272617:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827392 00000100:00100000:1.0:1787383316.272667:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:1.0:1787383316.272677:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+17:11481:x1874206962827392:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383316.272751:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.272767:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.272780:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.272996:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.273020:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.273028:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.273062:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.273076:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 18 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.273090:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979598336:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383316.273164:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383316.276601:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979598336:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383316.276636:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383316.279090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383316.279143:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827520 00000100:00100000:1.0:1787383316.279152:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827520 00010000:00010000:1.0:1787383316.279193:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383316.279234:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1787383316.279243:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962827520:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383316.279256:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383316.279271:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279284:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279304:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cf6c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3b7 expref: 19 pid: 8068 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279318:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:1.0:1787383316.279323:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279331:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279337:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279361:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383316.279404:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+18:2349:x1874206962827520:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 162us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.279413:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00010000:00010000:1.0:1787383316.279437:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383316.279445:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383316.279660:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787383316.279809:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787383316.279863:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787383316.279961:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979598464:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383316.280001:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383316.280027:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383316.280198:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979598464 00000100:00100000:2.0:1787383316.280207:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979598464 00000100:00100000:2.0:1787383316.280248:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383316.280257:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1874206979598464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787383316.280339:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1874206979598464:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383316.280346:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383316.280538:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787383316.280544:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffb029adf80, transno 4294967315 00000100:00100000:3.0:1787383316.280570:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979598464:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787383316.281511:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787383316.281856:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979598592:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787383316.281933:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383316.281958:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383316.282800:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979598592 00000100:00100000:2.0:1787383316.282810:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979598592 00000100:00100000:2.0:1787383316.282855:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383316.282864:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1874206979598592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787383316.283074:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1874206979598592:12345-0@lo:1000:mdt00_002.0 Request processed in 211us (1140us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787383316.283082:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383316.283555:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979598592:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787383316.283608:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283619:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283627:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283633:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ba00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383316.283637:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283645:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283662:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc035c5700) 00010000:00010000:3.0:1787383316.283665:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383316.283669:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283675:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf70c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283704:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283710:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283715:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283727:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383316.283730:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283735:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283743:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383316.283745:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383316.283748:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.283752:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf641 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.287411:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.287433:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.287443:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.287485:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.287509:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 21 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383316.287541:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979598720:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383316.287641:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383316.291567:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979598720:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383316.291598:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383316.292741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.292798:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827648 00000100:00100000:0.0:1787383316.292808:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827648 00010000:00010000:0.0:1787383316.292846:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 22 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383316.292917:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1787383316.292929:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:2349:x1874206962827648:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383316.292942:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383316.292948:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 22 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.292960:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 22 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.292982:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc00031000/0x42020b050d5cf65d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b39b expref: 22 pid: 5805 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.292998:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:0.0:1787383316.293003:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.293012:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.293027:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.293056:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383316.293108:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:2349:x1874206962827648:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 181us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383316.293116:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00010000:00010000:3.0:1787383316.293203:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293212:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293224:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293231:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293236:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293242:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383316.293246:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293254:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293264:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383316.293267:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383316.293281:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293299:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf713 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293310:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293316:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293322:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293327:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383316.293330:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293335:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293344:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383316.293346:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383316.293349:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.293354:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf705 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383316.293576:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11481:x1874206962827392:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 20899us (21126us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787383316.293585:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 186 00000020:00080000:3.0:1787383316.293595:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787383316.296692:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383316.296702:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383316.297235:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787383316.297243:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787383316.298039:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383316.299750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383316.299861:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962827904 00000100:00100000:0.0:1787383316.299905:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962827904 00000100:00100000:0.0:1787383316.299961:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:0.0:1787383316.299971:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11481:x1874206962827904:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787383316.300721:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787383316.300997:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787383316.301045:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301062:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301074:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301083:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301089:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301096:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383316.301126:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383316.301174:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383316.301180:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.301186:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047c00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383316.301191:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.301197:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.301210:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffc0a060a00) 00010000:00010000:3.0:1787383316.301214:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383316.301218:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.301224:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047c00/0x42020b050d5cf71a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383316.301241:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383316.301243:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383316.301244:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383316.301247:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:11481:x1874206962827904:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1276us (1503us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787383316.301256:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000020:00080000:0.0:1787383316.301262:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383317.322426:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383317.770388:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979599104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383317.770434:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979599232:0@lo:400:kworker.0 00000100:00100000:2.0:1787383317.770468:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383317.770529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383317.770531:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383317.770537:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979598848:0@lo:400:kworker.0 00000100:00100000:0.0:1787383317.770560:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383317.770565:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979598976:0@lo:400:kworker.0 00000100:00100000:2.0:1787383317.770566:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383317.770586:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383317.770587:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979599360:0@lo:400:kworker.0 00000100:00100000:0.0:1787383317.770600:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979599488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383317.770605:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383317.770618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383317.770632:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979598848 00000100:00100000:0.0:1787383317.770637:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599232 00000100:00100000:2.0:1787383317.770638:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979598848 00000100:00100000:0.0:1787383317.770640:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599232 00000100:00100000:0.0:1787383317.770674:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599488 00000100:00100000:0.0:1787383317.770676:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599488 00000100:00100000:2.0:1787383317.770677:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787383317.770684:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979598848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383317.770693:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787383317.770698:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979599232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383317.770947:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979598848:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383317.770966:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787383317.771051:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599104 00000100:00100000:3.0:1787383317.771055:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599104 00000100:00100000:3.0:1787383317.771087:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979598976 00000100:00100000:3.0:1787383317.771090:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979598976 00000100:00100000:3.0:1787383317.771101:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599360 00000100:00100000:3.0:1787383317.771103:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599360 00000100:00100000:3.0:1787383317.771127:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383317.771134:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979599104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.771179:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979599104:12345-0@lo:400:kworker.0 Request processed in 46us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383317.771185:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383317.771198:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383317.771203:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979598976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.771229:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979598976:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383317.771234:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383317.771244:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787383317.771250:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383317.771499:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979599232:12345-0@lo:400:kworker.0 Request processed in 799us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383317.771506:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787383317.771520:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787383317.771527:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979599488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383317.771616:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979599488:12345-0@lo:400:kworker.0 Request processed in 90us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383317.771627:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383317.772529:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979598848:0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.772573:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979599360:12345-0@lo:400:kworker.0 Request processed in 1321us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383317.772583:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787383317.772639:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979599360:0@lo:400:kworker.0 00000100:00080000:3.0:1787383317.772650:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383317.772652:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979599232:0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.772684:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979598976:0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.772696:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979599488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383317.772706:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979599104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383318.283604:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383318.283627:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979599616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383318.283708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383318.290343:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599616 00000100:00100000:1.0:1787383318.290360:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599616 00000100:00100000:1.0:1787383318.290504:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383318.290516:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979599616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383318.290558:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383318.290649:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979599616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (6940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.290656:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383318.291040:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979599616:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787383318.292792:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787383318.302603:0:12369:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383318.302840:0:12369:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383318.302955:0:12369:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787383318.302964:0:12369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787383318.346207:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383318.407601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383318.407687:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962828160 00000100:00100000:0.0:1787383318.407697:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962828160 00000100:00100000:0.0:1787383318.407778:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:0.0:1787383318.407790:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:11500:x1874206962828160:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383318.407814:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383318.407834:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3d3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787383318.408022:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383318.408344:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf728 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383318.408360:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383318.408371:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383318.408383:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787383318.408568:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cf721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3d3 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383318.408585:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3d3 expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383318.408594:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:0.0:1787383318.408597:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383318.408608:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046400, rc 0) 00000100:00100000:0.0:1787383318.408715:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11500:x1874206962828160:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 927us (1123us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787383318.408724:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:1.0:1787383318.413461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383318.413551:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962828288 00000100:00100000:3.0:1787383318.413561:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962828288 00000100:00100000:3.0:1787383318.413625:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:3.0:1787383318.413645:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11500:x1874206962828288:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1787383318.413724:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.413742:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.413755:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.413770:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.413777:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.413783:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414304:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414315:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414323:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383318.414366:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414379:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414392:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414399:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414406:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383318.414410:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414418:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414431:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383318.414434:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383318.414438:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414445:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf736 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414458:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414463:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414479:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414484:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383318.414493:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414500:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414509:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc094fe100) 00010000:00010000:3.0:1787383318.414511:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383318.414514:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414520:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf73d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414535:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414540:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414545:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414550:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383318.414553:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414558:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414566:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc094fe200) 00010000:00010000:3.0:1787383318.414568:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383318.414578:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.414585:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383318.414723:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11500:x1874206962828288:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1079us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383318.414732:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:3.0:1787383318.470108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.470321:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962828544 00000100:00100000:2.0:1787383318.470333:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962828544 00000100:00100000:2.0:1787383318.470394:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1787383318.470403:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11503:x1874206962828544:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383318.470423:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383318.470442:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf74b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3da expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470528:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470542:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470554:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470570:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470590:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.470598:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471551:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471566:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471574:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383318.471585:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787383318.471682:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471689:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471696:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471702:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.471706:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471714:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471739:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383318.471742:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.471747:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471753:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf752 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471766:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471772:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471778:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471782:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.471785:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471791:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471799:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383318.471802:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.471805:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.471810:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.472409:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf74b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 27 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.472429:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 26 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.472436:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383318.472438:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383318.472441:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383318.472527:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:11503:x1874206962828544:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2123us (2427us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787383318.472536:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:1.0:1787383318.480162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.480200:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962828672 00000100:00100000:1.0:1787383318.480210:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962828672 00000100:00100000:1.0:1787383318.480264:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1787383318.480275:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:11503:x1874206962828672:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383318.480346:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480381:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480393:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480432:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480439:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480446:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480451:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383318.480456:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480463:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480492:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.480495:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383318.480499:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.480505:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf76e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.480573:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:11503:x1874206962828672:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 300us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.480588:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:2.0:1787383318.491424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.491480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962828928 00000100:00100000:2.0:1787383318.491490:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962828928 00000100:00100000:2.0:1787383318.491551:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1787383318.491562:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+26:11503:x1874206962828928:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383318.491800:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:11503:x1874206962828928:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 239us (383us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787383318.491808:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:3.0:1787383318.556517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383318.564506:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829184 00000100:00100000:0.0:1787383318.564526:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829184 00000100:00100000:2.0:1787383318.566406:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1787383318.566422:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:11029:x1874206962829184:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383318.566443:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383318.566463:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf775 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3e1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.566595:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.566610:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.566619:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.566664:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 28 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.566677:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 28 pid: 8068 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383318.568421:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979599744:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383318.568554:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e88840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383318.575707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383318.575933:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb025c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979599744:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383318.575964:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.576386:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829312 00000100:00100000:1.0:1787383318.576395:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829312 00010000:00010000:1.0:1787383318.576438:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 29 pid: 8068 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.576526:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1787383318.576536:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:2348:x1874206962829312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383318.576553:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383318.576561:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 29 pid: 8068 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576574:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 29 pid: 8068 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576596:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3da expref: 29 pid: 8068 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576613:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.576618:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576628:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576636:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.576690:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383318.576761:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:2348:x1874206962829312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 225us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.576769:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00010000:00010000:2.0:1787383318.577567:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.577579:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383318.577600:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787383318.577799:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515a00/0x42020b050d5cf775 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.577839:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.577847:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383318.577849:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383318.577853:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515c00, rc 0) 00000100:00100000:2.0:1787383318.577963:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:11029:x1874206962829184:12345-192.168.202.19@tcp:101:bash.0 Request processed in 11547us (21457us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787383318.577971:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1787383318.583296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.583460:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829568 00000100:00100000:1.0:1787383318.583480:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829568 00000100:00100000:1.0:1787383318.583587:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:1.0:1787383318.583599:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+28:11029:x1874206962829568:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1787383318.584283:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.584304:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.584317:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383318.584514:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787383318.584548:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000629ab038 reply state 000000001389bc71 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.584557:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787383318.584608:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787383318.584800:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11029:x1874206962829568:12345-192.168.202.19@tcp:36:bash.0 Request processed in 1201us (1511us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787383318.584810:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000020:00080000:1.0:1787383318.584817:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787383318.595614:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595652:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595659:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595666:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383318.595672:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595680:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595697:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.595699:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383318.595704:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.595709:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf78a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383318.596008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.596624:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829696 00000100:00100000:1.0:1787383318.596634:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829696 00000100:00100000:1.0:1787383318.596695:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:1.0:1787383318.596706:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:11029:x1874206962829696:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383318.596730:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383318.596758:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3e8 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.596814:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e8 expref: 32 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.596839:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e8 expref: 32 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.596862:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.596864:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383318.596895:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b800, rc 0) 00000100:00100000:1.0:1787383318.596968:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11029:x1874206962829696:12345-192.168.202.19@tcp:101:bash.0 Request processed in 263us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.596976:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:0.0:1787383318.600480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.600663:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829824 00000100:00100000:2.0:1787383318.600676:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829824 00000100:00100000:2.0:1787383318.600860:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1787383318.600902:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:11029:x1874206962829824:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383318.600926:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383318.600951:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3ef expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383318.600993:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a894e13, atime: 0x6a894e12, ctime: 0x6a894e13, blocks: 0xb 00010000:00010000:2.0:1787383318.601020:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1787383318.601025:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383318.601035:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.601085:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.601100:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01515a00, rc 0) 00000100:00100000:2.0:1787383318.601181:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:11029:x1874206962829824:12345-192.168.202.19@tcp:101:bash.0 Request processed in 310us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383318.601189:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00080000:3.0:1787383318.603964:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383318.618683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.619266:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962829952 00000100:00100000:2.0:1787383318.619282:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962829952 00002000:00010000:2.0:1787383318.619358:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787383318.619364:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc171b0e00 with x1874206962829952 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383318.619381:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc171b0e00. 00000100:00100000:2.0:1787383318.619422:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1787383318.619434:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962829952:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:2.0:1787383318.619827:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787383318.619832:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787383315 -> 1787383319 00002000:00010000:2.0:1787383318.619835:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787383314 -> 1787383314 00002000:00010000:2.0:1787383318.619838:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787383315 -> 1787383319 00002000:00010000:2.0:1787383318.619840:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787383318.619981:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962829952:12345-192.168.202.19@tcp:10:bash.0 Request processed in 548us (1314us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787383318.619991:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00002000:00010000:2.0:1787383318.619995:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787383318.619998:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc171b0e00 with x1874206962829952 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383318.620020:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc171b0e00. 00000100:00100000:1.0:1787383318.759456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383318.759561:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962830080 00000100:00100000:3.0:1787383318.759580:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962830080 00000100:00100000:3.0:1787383318.759665:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:3.0:1787383318.759678:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11517:x1874206962830080:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1787383318.759781:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.759799:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.759810:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.759822:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.759843:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383318.759847:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.760965:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.760983:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.760993:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383318.761124:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761138:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761145:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761152:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761159:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.761164:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761172:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761186:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383318.761189:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.761194:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761212:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf79f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761226:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761232:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761237:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761242:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.761245:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761250:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761257:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc094fe200) 00010000:00010000:2.0:1787383318.761260:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.761262:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761268:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf7a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761525:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761531:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761543:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761548:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.761551:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761558:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761567:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383318.761570:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.761573:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.761579:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383318.761758:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11517:x1874206962830080:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 2077us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383318.761770:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:1.0:1787383318.796609:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383318.796644:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979599872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383318.796727:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383318.796911:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979599872 00000100:00100000:2.0:1787383318.796920:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979599872 00000100:00100000:2.0:1787383318.796996:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383318.797006:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874206979599872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383318.797044:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383318.797097:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874206979599872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383318.797104:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787383318.797140:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383318.797237:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979599872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383318.798564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.798728:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962830336 00000100:00100000:1.0:1787383318.798737:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962830336 00000100:00100000:1.0:1787383318.798789:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:1.0:1787383318.798797:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11520:x1874206962830336:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383318.798818:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383318.798843:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf7b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3f6 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.798952:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.798968:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.798995:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799007:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799011:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799015:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799448:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf7c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799457:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799474:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383318.799486:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787383318.799787:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799795:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799803:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799810:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383318.799822:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799934:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799949:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383318.799952:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383318.799957:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799964:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf7bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799977:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799982:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799987:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.799993:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383318.799996:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800000:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800006:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc01425700) 00010000:00010000:1.0:1787383318.800007:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383318.800015:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800072:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf7c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800125:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf7b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3f6 expref: 35 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800141:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3f6 expref: 34 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.800148:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.800239:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787383318.800242:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b000, rc 0) 00000100:00100000:1.0:1787383318.800388:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11520:x1874206962830336:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1590us (1959us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787383318.800398:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:2.0:1787383318.805440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.805632:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962830464 00000100:00100000:1.0:1787383318.805646:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962830464 00000100:00100000:1.0:1787383318.805760:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:1.0:1787383318.805774:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11520:x1874206962830464:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383318.805908:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.805930:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.805940:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.806004:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.806032:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 34 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.806051:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d712d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979600000:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383318.806186:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383318.809379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383318.809637:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962830720 00000100:00100000:3.0:1787383318.809650:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962830720 00000100:00100000:3.0:1787383318.809725:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1787383318.809737:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:5561:x1874206962830720:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787383318.810200:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:5561:x1874206962830720:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 463us (833us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787383318.810211:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1787383318.810819:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d712d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979600000:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383318.810853:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383318.812632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383318.812759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962830848 00000100:00100000:1.0:1787383318.812771:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962830848 00010000:00010000:1.0:1787383318.812821:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 36 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383318.812946:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1787383318.812957:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:2348:x1874206962830848:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383318.812973:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383318.812981:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 36 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.812995:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 36 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.813056:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf77c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e1 expref: 36 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.813077:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383318.813083:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.813093:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.813102:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383318.813141:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383318.813210:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:2348:x1874206962830848:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 254us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.813218:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00010000:00010000:2.0:1787383318.813455:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813473:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813514:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813521:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813528:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813545:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.813550:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813558:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813569:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383318.813572:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383318.813576:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.813583:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cf7d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383318.813645:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11520:x1874206962830464:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 7874us (8219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383318.813662:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:3.0:1787383318.822969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.823109:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962831104 00000100:00100000:2.0:1787383318.823123:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962831104 00000100:00100000:2.0:1787383318.823196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1787383318.823209:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+34:11520:x1874206962831104:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383318.823603:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:11520:x1874206962831104:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 395us (647us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787383318.823613:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1787383318.922747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.924048:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962831360 00000100:00100000:2.0:1787383318.924066:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962831360 00000100:00100000:2.0:1787383318.924159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:2.0:1787383318.924170:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+35:11531:x1874206962831360:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383318.924213:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383318.924241:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf7de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b3fd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924374:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924392:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924405:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924421:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924693:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.924701:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.925848:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.925897:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.925908:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383318.925920:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787383318.926046:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926054:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926062:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926068:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.926074:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926082:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926112:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383318.926115:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.926120:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926126:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf7e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926141:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926147:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926153:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926158:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383318.926161:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926167:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926173:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383318.926175:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383318.926177:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.926183:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf7ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.929826:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf7de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3fd expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.929862:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3fd expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383318.929910:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383318.929913:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383318.929918:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc01514a00, rc 0) 00000100:00100000:2.0:1787383318.930018:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11531:x1874206962831360:12345-192.168.202.19@tcp:101:cat.0 Request processed in 5847us (7283us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787383318.930029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:3.0:1787383318.940650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383318.940942:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962831616 00000100:00100000:2.0:1787383318.940956:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962831616 00000100:00100000:2.0:1787383318.941030:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1787383318.941042:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11531:x1874206962831616:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:2.0:1787383318.941408:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:11531:x1874206962831616:12345-192.168.202.19@tcp:35:cat.0 Request processed in 367us (771us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787383318.941417:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1787383319.008188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.008376:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962831872 00000100:00100000:2.0:1787383319.008391:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962831872 00000100:00100000:2.0:1787383319.008484:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:2.0:1787383319.008497:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:11532:x1874206962831872:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1787383319.008581:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787383319.008618:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514a00/0x42020b050d5cf7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3fd expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008663:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf7c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3f6 expref: 37 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008675:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3e8 expref: 36 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008687:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383319.008701:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383319.008729:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008746:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008757:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008772:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008780:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.008785:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.009500:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.009512:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.009527:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383319.011549:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787383319.011570:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343225701230ns, next at 344225695951ns, rc = 0 00010000:00010000:2.0:1787383319.011694:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011713:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011725:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011735:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011742:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011750:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011937:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383319.011969:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011977:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011984:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.011998:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.012004:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012013:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012027:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5d00) 00010000:00010000:2.0:1787383319.012031:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787383319.012147:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012153:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515c00/0x42020b050d5cf80f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012181:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012188:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012195:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012200:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01514c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.012203:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012209:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012230:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383319.012232:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383319.012236:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.012242:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514c00/0x42020b050d5cf801 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383319.012254:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5639273 reply state 0000000008b6898d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.012265:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383319.012530:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+37:11532:x1874206962831872:12345-192.168.202.19@tcp:36:rm.0 Request processed in 4029us (4351us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787383319.012542:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 198 00010000:00010000:3.0:1787383319.017504:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383319.017526:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.017541:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519ca00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383319.017548:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.017561:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.017608:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffc035c5d00) 00010000:00010000:3.0:1787383319.017611:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383319.017617:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.017622:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ca00/0x42020b050d5cf816 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.017650:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383319.017652:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383319.017654:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383319.018311:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018326:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018334:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018340:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01515000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.018345:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018363:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018376:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383319.018378:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.018382:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.018389:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01515000/0x42020b050d5cf808 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.058692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.058823:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832128 00000100:00100000:2.0:1787383319.058838:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832128 00000100:00100000:2.0:1787383319.058959:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:2.0:1787383319.058981:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+36:11538:x1874206962832128:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1787383319.059015:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383319.059049:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ce00/0x42020b050d5cf81d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b404 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059226:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059244:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059292:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059311:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059319:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.059325:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383319.060053:0:8068:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787383319.060268:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060281:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060291:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060334:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060342:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060349:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060356:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.060369:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060377:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060393:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383319.060396:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383319.060401:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060409:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cf824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383319.060425:0:8068:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df8b4e2f reply state 00000000b0482603 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.060435:0:8068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787383319.060488:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519ce00/0x42020b050d5cf81d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 39 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060505:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 38 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.060513:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.060516:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383319.060519:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519de00, rc 0) 00000100:00100000:2.0:1787383319.060617:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:11538:x1874206962832128:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1648us (1939us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787383319.060626:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00010000:00010000:1.0:1787383319.063709:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063732:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063740:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063747:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.063754:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063762:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063785:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5000) 00010000:00010000:1.0:1787383319.063789:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.063813:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.063820:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d200/0x42020b050d5cf82b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.066938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.067570:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832256 00000100:00100000:0.0:1787383319.067585:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832256 00000100:00100000:0.0:1787383319.067691:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:0.0:1787383319.067704:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962832256:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383319.067726:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383319.067758:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b40b expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383319.067792:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787383319.067818:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1787383319.067823:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383319.067833:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.067856:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.067914:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046c00, rc 0) 00000100:00100000:0.0:1787383319.068002:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962832256:12345-192.168.202.19@tcp:101:bash.0 Request processed in 300us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.068042:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:3.0:1787383319.068132:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383319.072307:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.072432:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832384 00000100:00100000:0.0:1787383319.072447:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832384 00000100:00100000:0.0:1787383319.072532:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1787383319.072543:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:11538:x1874206962832384:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383319.072568:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383319.072592:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b412 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.072633:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.072644:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383319.072649:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383319.072655:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.072698:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.072714:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 7 pid: 6600 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.072731:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874206979600128:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383319.073012:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383319.076162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.076307:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832512 00000100:00100000:3.0:1787383319.076320:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832512 00010000:00010000:3.0:1787383319.076374:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 8 pid: 6600 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.076435:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:3.0:1787383319.076447:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962832512:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383319.076492:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383319.076525:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 8 pid: 6600 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.076543:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 8 pid: 6600 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.076578:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383319.076602:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383319.076615:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.076629:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.076682:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.076698:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1874206979600256:192.168.202.19@tcp:105: 00000100:00100000:3.0:1787383319.076791:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ad80 going to sleep for 11 seconds 00010000:00010000:0.0:1787383319.076937:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d12abc7/0x42020b050d5cf840 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b40b expref: 8 pid: 6600 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.076955:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874206979600128:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383319.076984:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.076997:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047400, rc 0) 00000100:00100000:0.0:1787383319.077046:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:11538:x1874206962832384:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4492us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.077054:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1787383319.083945:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1874206979600256:192.168.202.19@tcp:105: 00010000:00010000:3.0:1787383319.083995:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383319.084077:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962832512:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 7631us (7928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383319.084089:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1787383319.087225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.087366:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832768 00000100:00100000:3.0:1787383319.087379:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832768 00000100:00100000:3.0:1787383319.087538:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:3.0:1787383319.087553:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+38:11538:x1874206962832768:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1787383319.088122:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:11538:x1874206962832768:12345-192.168.202.19@tcp:35:bash.0 Request processed in 570us (909us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787383319.088133:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1787383319.229450:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.229594:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962832896 00000100:00100000:1.0:1787383319.229608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962832896 00000100:00100000:1.0:1787383319.229725:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:1.0:1787383319.229739:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+39:11554:x1874206962832896:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.229774:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.229801:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf84e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b419 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.229936:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.229955:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.229971:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383319.230126:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787383319.230131:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383319.230163:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.230194:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf84e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b419 expref: 41 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.230243:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b419 expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.230252:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383319.230256:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383319.230260:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a000, rc 0) 00000100:00100000:1.0:1787383319.230420:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11554:x1874206962832896:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 684us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383319.230429:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:3.0:1787383319.235309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.235377:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833152 00000100:00100000:2.0:1787383319.235391:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833152 00000100:00100000:2.0:1787383319.235456:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:2.0:1787383319.235478:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+40:11554:x1874206962833152:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383319.235505:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383319.235530:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf85c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b420 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.235660:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.235678:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.235691:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383319.235705:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787383319.235856:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf85c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b420 expref: 43 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.235900:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b420 expref: 42 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.235910:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.235929:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383319.235934:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c600, rc 0) 00000100:00100000:2.0:1787383319.236494:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:11554:x1874206962833152:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1015us (1196us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787383319.236504:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:3.0:1787383319.240943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.241041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.241219:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833408 00000100:00100000:1.0:1787383319.241234:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833408 00000100:00100000:1.0:1787383319.241313:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:1.0:1787383319.241325:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+42:11554:x1874206962833408:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.241358:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.241385:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b427 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.241535:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.241553:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.241566:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383319.241581:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787383319.241758:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b427 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.241782:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b427 expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.241792:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:1.0:1787383319.241796:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787383319.241800:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6be00, rc 0) 00000100:00100000:1.0:1787383319.241908:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:11554:x1874206962833408:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 584us (980us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787383319.241917:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:2.0:1787383319.242139:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833536 00000100:00100000:2.0:1787383319.242145:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833536 00000100:00100000:2.0:1787383319.242197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1787383319.242206:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+44:2351:x1874206962833536:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383319.242217:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383319.242235:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b420 expref: 44 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.242247:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.242250:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383319.242284:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:2351:x1874206962833536:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 80us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.242292:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1787383319.249112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.249207:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833664 00000100:00100000:0.0:1787383319.249220:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833664 00000100:00100000:0.0:1787383319.249325:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1787383319.249338:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+6:2349:x1874206962833664:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:0.0:1787383319.249402:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.249429:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.249440:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383319.249444:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383319.249450:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.249525:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.249540:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 6 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.249560:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6600:1874206979600384:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383319.249672:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383319.253024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.253185:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6600:1874206979600384:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383319.253224:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.253713:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833792 00000100:00100000:3.0:1787383319.253723:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833792 00002000:00100000:3.0:1787383319.253790:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ffb029b7480 x1874206962833792/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:105/0 lens 504/0 e 0 to 0 dl 1787383330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787383319.253801:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffb029b7480 with x1874206962833792 ext(0->8) 00010000:00010000:3.0:1787383319.253810:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 7 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.253826:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 7 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383319.253834:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffb029b7480 00000100:00100000:3.0:1787383319.253906:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1787383319.253917:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962833792:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:3.0:1787383319.254713:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962833792:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 791us (1697us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787383319.254725:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:3.0:1787383319.254733:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ffb029b7480 x1874206962833792/t4294967308(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:105/0 lens 504/448 e 0 to 0 dl 1787383330 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787383319.254742:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffb029b7480 with x1874206962833792 ext(0->8) 00010000:00010000:3.0:1787383319.254749:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.254762:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383319.254777:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffb029b7480 00000100:00100000:3.0:1787383319.258149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.258386:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962833920 00000100:00100000:2.0:1787383319.258399:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962833920 00010000:00010000:2.0:1787383319.258453:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.258576:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:2.0:1787383319.258588:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2351:x1874206962833920:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383319.258608:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787383319.258633:0:8310:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787383319.258637:0:8310:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787383319 00002000:00010000:2.0:1787383319.258639:0:8310:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787383319 00002000:00010000:2.0:1787383319.258641:0:8310:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787383319 00010000:00010000:2.0:1787383319.258649:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.258666:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.258695:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6ede567/0x42020b050d5cf847 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b412 expref: 9 pid: 6599 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.258714:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383319.258718:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383319.258725:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.258736:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.258774:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383319.258852:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2351:x1874206962833920:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 266us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.258861:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00010000:00010000:0.0:1787383319.258950:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.258962:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.258999:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259009:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259017:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259025:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383319.259044:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259055:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259068:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.259075:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ccd61f5/0x42020b050d5cf886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.259127:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962833664:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 9793us (10029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.259136:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1787383319.262839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.269209:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962834176 00000100:00100000:2.0:1787383319.269229:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962834176 00000100:00100000:2.0:1787383319.269319:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1787383319.269331:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+43:11554:x1874206962834176:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1787383319.269420:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b427 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383319.270311:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787383319.270354:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787383319.270725:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787383319.270785:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.270807:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 47 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.270817:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.270861:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 47 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.270924:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 47 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.270942:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979600512:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383319.271325:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0985e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383319.274255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.274544:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962834304 00000100:00100000:0.0:1787383319.274557:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962834304 00010000:00010000:0.0:1787383319.274611:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 48 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.274657:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:0.0:1787383319.274669:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:2348:x1874206962834304:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383319.274691:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383319.274699:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 48 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.274738:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 48 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.274767:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:0.0:1787383319.274773:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.274784:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.274792:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.274817:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383319.274903:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+48:2348:x1874206962834304:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 235us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.274911:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00010000:00010000:2.0:1787383319.275848:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b404 expref: 47 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.275899:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1874206979600512:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383319.275926:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.275937:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.275943:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383319.276127:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787383319.276364:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787383319.276500:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979600640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383319.279887:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383319.279939:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0985e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383319.280028:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979600640 00000100:00100000:3.0:1787383319.280054:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979600640 00000100:00100000:3.0:1787383319.280138:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383319.280151:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1874206979600640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383319.280306:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1874206979600640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383319.280315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383319.280453:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979600640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787383319.281079:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787383319.281167:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979600768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383319.281223:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383319.281251:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05e88840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383319.281284:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979600768 00000100:00100000:3.0:1787383319.281293:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979600768 00000100:00100000:3.0:1787383319.281343:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383319.281352:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1874206979600768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383319.281614:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5806:x1874206979600768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 263us (389us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787383319.281622:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383319.282456:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d7e0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1874206979600768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787383319.282544:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787383319.282595:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282616:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282623:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282629:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.282634:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282641:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282657:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.282660:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787383319.282665:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.282671:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf88d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383319.282863:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787383319.282997:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787383319.283007:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343497138403ns, next at 344497136141ns, rc = 0 00000001:00080000:2.0:1787383319.283014:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787383319.283047:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.283050:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787383319.283057:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf878 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b427 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.283181:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:11554:x1874206962834176:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 13851us (20353us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787383319.283192:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000020:00080000:2.0:1787383319.283198:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787383319.286587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.286797:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962834432 00000100:00100000:1.0:1787383319.286810:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962834432 00000100:00100000:1.0:1787383319.286935:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:1.0:1787383319.286947:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+50:11554:x1874206962834432:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.286978:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.287010:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b42e expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.287098:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b42e expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.287116:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b42e expref: 51 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.287138:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.287159:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383319.287165:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ba00, rc 0) 00000100:00100000:1.0:1787383319.287232:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:11554:x1874206962834432:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 287us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383319.287240:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:3.0:1787383319.292547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.292947:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962834688 00000100:00100000:0.0:1787383319.292960:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962834688 00000100:00100000:0.0:1787383319.293141:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1787383319.293155:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+51:11554:x1874206962834688:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383319.293679:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11554:x1874206962834688:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 525us (1144us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787383319.293688:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00010000:00010000:0.0:1787383319.370173:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383319.397581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.397702:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962834816 00000100:00100000:2.0:1787383319.397712:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962834816 00000100:00100000:2.0:1787383319.397782:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:2.0:1787383319.397794:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11564:x1874206962834816:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1787383319.397911:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.397930:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.397944:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.397960:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.397967:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.397973:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398072:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398098:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398105:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383319.398145:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398159:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398165:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398172:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398178:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.398181:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398188:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398200:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383319.398202:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383319.398206:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398212:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c600/0x42020b050d5cf89b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398231:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398251:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398257:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398262:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519de00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.398265:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398271:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398279:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383319.398282:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383319.398285:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398291:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf8a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398498:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398505:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398510:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398523:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383319.398526:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398532:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398541:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383319.398543:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383319.398546:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.398552:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d600/0x42020b050d5cf8a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.399381:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11564:x1874206962834816:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1584us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.399392:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:3.0:1787383319.436784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.436944:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962835072 00000100:00100000:1.0:1787383319.436957:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962835072 00000100:00100000:1.0:1787383319.437046:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:1.0:1787383319.437057:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+52:11567:x1874206962835072:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.437084:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.437110:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b435 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437203:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437219:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437232:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437249:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437257:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437264:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437450:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437469:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437477:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383319.437488:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787383319.437604:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437612:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437619:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437626:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.437630:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437638:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437651:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383319.437654:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.437660:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437677:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf8b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437693:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437699:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437705:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437710:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.437713:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437718:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437724:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc01425c00) 00010000:00010000:1.0:1787383319.437726:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.437729:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437733:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf8be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437780:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437794:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 54 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.437809:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.437811:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383319.437814:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a200, rc 0) 00000100:00100000:1.0:1787383319.437971:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:11567:x1874206962835072:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 914us (1201us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787383319.437979:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:3.0:1787383319.440625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.440758:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962835200 00000100:00100000:1.0:1787383319.440770:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962835200 00000100:00100000:1.0:1787383319.440840:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:1.0:1787383319.440852:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:11567:x1874206962835200:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1787383319.440958:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.440989:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441004:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441049:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441057:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441065:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441071:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ac00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.441092:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441101:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441115:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.441119:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383319.441124:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.441130:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.441222:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:11567:x1874206962835200:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 372us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383319.441231:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:2.0:1787383319.444000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.444154:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962835456 00000100:00100000:0.0:1787383319.444164:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962835456 00000100:00100000:0.0:1787383319.444251:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1787383319.444262:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+54:11567:x1874206962835456:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383319.444494:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11567:x1874206962835456:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 233us (503us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787383319.444502:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1787383319.524326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.527163:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962835712 00000100:00100000:1.0:1787383319.527178:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962835712 00000100:00100000:1.0:1787383319.527362:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:1.0:1787383319.527373:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11577:x1874206962835712:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1787383319.527398:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.527402:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383319.527429:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a000/0x42020b050d5cf855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b419 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527449:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383319.527454:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383319.527478:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b43c expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527598:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527612:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527620:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527656:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.527671:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 55 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.527684:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979600896:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383319.527786:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383319.531454:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979600896:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383319.531495:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383319.532443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.532804:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962835840 00000100:00100000:3.0:1787383319.532819:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962835840 00010000:00010000:3.0:1787383319.532906:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 56 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.533000:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1787383319.533015:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+56:2349:x1874206962835840:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383319.533037:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383319.533047:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 56 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533064:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 56 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533093:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a200/0x42020b050d5cf8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b435 expref: 56 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533117:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383319.533123:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533135:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533144:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.533181:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383319.533246:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.533261:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.533283:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:2349:x1874206962835840:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 260us (833us total) trans 0 rc 0/0 00000004:00200000:1.0:1787383319.533286:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1787383319.533295:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00010000:00010000:1.0:1787383319.533479:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ac00/0x42020b050d5cf8da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 56 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.533503:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 55 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.533513:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.533516:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383319.533520:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b400, rc 0) 00000100:00100000:1.0:1787383319.533577:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11577:x1874206962835712:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6206us (9259us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787383319.533586:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:2.0:1787383319.537222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.541109:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836096 00000100:00100000:1.0:1787383319.541124:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836096 00000100:00100000:0.0:1787383319.541327:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:0.0:1787383319.541345:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+55:11577:x1874206962836096:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1787383319.541718:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.541742:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.541757:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383319.541821:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787383319.541849:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2e6d374 reply state 0000000072e8b1bd transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.541860:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383319.542481:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11577:x1874206962836096:12345-192.168.202.19@tcp:36:bash.0 Request processed in 1134us (5262us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787383319.542493:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 208 00000020:00080000:0.0:1787383319.542499:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787383319.546931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1787383319.547082:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547099:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547112:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547120:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.547126:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547135:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547157:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.547180:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.547186:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.547193:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cf8ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.547680:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836224 00000100:00100000:3.0:1787383319.547701:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836224 00000100:00100000:3.0:1787383319.547775:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:3.0:1787383319.547787:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11577:x1874206962836224:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1787383319.547820:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383319.547843:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf8f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b443 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.548006:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.548021:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.548039:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.548082:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 58 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.548097:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 58 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.548114:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979601024:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383319.548223:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383319.551418:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979601024:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383319.551453:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383319.551475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.551641:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836352 00000100:00100000:0.0:1787383319.551652:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836352 00010000:00010000:0.0:1787383319.551706:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 59 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.551776:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1787383319.551787:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:2349:x1874206962836352:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383319.551808:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383319.551816:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 59 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551830:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 59 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551856:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b400/0x42020b050d5cf8e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b43c expref: 59 pid: 8068 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551918:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:0.0:1787383319.551925:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551937:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551945:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.551983:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383319.552063:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:2349:x1874206962836352:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 277us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.552072:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00010000:00010000:2.0:1787383319.552209:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.552222:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383319.552294:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787383319.552299:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383319.552323:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.552363:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cf8f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.552385:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.552404:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383319.552407:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383319.552410:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:2.0:1787383319.552489:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11577:x1874206962836224:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4705us (5573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.552506:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:3.0:1787383319.555363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.555486:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836608 00000100:00100000:0.0:1787383319.555517:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836608 00000100:00100000:0.0:1787383319.555588:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:0.0:1787383319.555601:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+57:11577:x1874206962836608:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:0.0:1787383319.560114:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11577:x1874206962836608:12345-192.168.202.19@tcp:35:bash.0 Request processed in 4495us (4744us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787383319.560134:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1787383319.643439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.643521:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836736 00000100:00100000:3.0:1787383319.643534:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836736 00000100:00100000:3.0:1787383319.643681:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:3.0:1787383319.643712:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+58:11583:x1874206962836736:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383319.643758:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383319.643788:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b44a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.643933:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.643950:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.643973:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383319.644068:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787383319.644073:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383319.644103:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.644134:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cf904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b44a expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.644159:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b44a expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.644169:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383319.644172:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383319.644176:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383319.644268:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962836736:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 559us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383319.644304:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:3.0:1787383319.649485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383319.649787:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962836864 00000100:00100000:1.0:1787383319.649802:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962836864 00000100:00100000:1.0:1787383319.650303:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1787383319.650317:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962836864:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.650345:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.650375:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b451 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650510:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650532:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650547:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650565:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650572:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650578:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650740:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650750:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650758:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383319.650807:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787383319.650823:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383319.650845:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650859:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650901:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650909:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650916:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650922:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.650927:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650936:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650957:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:1.0:1787383319.650960:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.650965:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650971:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6bc00/0x42020b050d5cf919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650987:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650993:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.650999:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651004:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383319.651006:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651011:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651018:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc01425c00) 00010000:00010000:1.0:1787383319.651020:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383319.651023:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651043:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651092:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b451 expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651107:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b451 expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.651117:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.651119:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383319.651121:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6ae00, rc 0) 00000100:00100000:1.0:1787383319.651212:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11583:x1874206962836864:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 898us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383319.651221:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:2.0:1787383319.657333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.657441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.657584:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837248 00000100:00100000:3.0:1787383319.657598:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837248 00000100:00100000:3.0:1787383319.657687:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1787383319.657700:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:2349:x1874206962837248:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383319.657719:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383319.657823:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ae00/0x42020b050d5cf927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b451 expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.657850:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383319.657857:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383319.658168:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:2349:x1874206962837248:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 329us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383319.658178:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383319.660075:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837120 00000100:00100000:1.0:1787383319.660095:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837120 00000100:00100000:1.0:1787383319.660180:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:1.0:1787383319.660228:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962837120:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383319.660290:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383319.660318:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf92e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b458 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.660505:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.660523:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.660533:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.660599:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.660614:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 60 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.660630:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979601152:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383319.660777:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383319.668774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383319.670146:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837376 00000100:00100000:0.0:1787383319.670165:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837376 00010000:00010000:0.0:1787383319.670231:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 61 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383319.670298:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1787383319.670311:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:2348:x1874206962837376:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383319.670332:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383319.670341:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 61 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.670359:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 61 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.670387:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:0.0:1787383319.670393:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.670405:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.670412:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383319.670470:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383319.670848:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:2348:x1874206962837376:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 536us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.670857:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:1.0:1787383319.671475:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cf8fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b443 expref: 60 pid: 5803 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383319.671499:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8068:1874206979601152:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383319.671525:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.671536:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.671542:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383319.671566:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787383319.673123:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf92e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 61 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.673158:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383319.673195:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383319.673199:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383319.673203:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b000, rc 0) 00000100:00100000:1.0:1787383319.673277:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11583:x1874206962837120:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 13065us (15957us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787383319.673287:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:2.0:1787383319.678323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383319.678422:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837632 00000100:00100000:3.0:1787383319.678436:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837632 00000100:00100000:3.0:1787383319.678551:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1787383319.678564:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11583:x1874206962837632:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:3.0:1787383319.678585:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383319.678617:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6ba00/0x42020b050d5cf894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b42e expref: 60 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383319.678639:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383319.678645:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383319.678743:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962837632:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 181us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383319.678751:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1787383319.682087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.682206:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837760 00000100:00100000:2.0:1787383319.682219:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837760 00000100:00100000:2.0:1787383319.682378:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:2.0:1787383319.682391:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962837760:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:2.0:1787383319.682542:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.682580:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.682596:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383319.687688:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787383319.688214:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962837760:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 5816us (6398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.688231:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:0.0:1787383319.691435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383319.691562:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962837888 00000100:00100000:2.0:1787383319.691576:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962837888 00000100:00100000:2.0:1787383319.691691:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:2.0:1787383319.691705:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+59:11583:x1874206962837888:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383319.691805:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383319.692171:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b45f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692252:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692265:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692289:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692303:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692340:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383319.692344:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383319.692349:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383319.692357:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c000, rc 0) 00000100:00100000:2.0:1787383319.692477:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11583:x1874206962837888:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 774us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383319.692486:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 214 00000001:00080000:2.0:1787383319.917837:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787383319.920334:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787383319.920602:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:1.0:1787383320.394259:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383320.394277:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383320.394510:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787383320.394532:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383320.394721:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979601280:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787383320.395033:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5913c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787383320.398308:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383320.398974:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979601280:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383320.401859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.402940:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962838016 00000100:00100000:1.0:1787383320.402957:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962838016 00000100:00100000:1.0:1787383320.403235:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:1.0:1787383320.403251:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cfff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11584:x1874206962838016:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787383320.403299:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787383320.403682:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cfff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11584:x1874206962838016:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 435us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.403692:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00080000:3.0:1787383320.404492:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383320.407555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.408124:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962838144 00000100:00100000:1.0:1787383320.408140:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962838144 00000100:00100000:1.0:1787383320.408280:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:1.0:1787383320.408294:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11584:x1874206962838144:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383320.408431:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408468:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408484:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408504:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408512:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408519:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408549:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408558:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408565:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383320.408629:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787383320.408634:0:8068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383320.408650:0:8068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408664:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408678:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408686:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408692:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383320.408697:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408706:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408721:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:1.0:1787383320.408724:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383320.408730:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408736:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b800/0x42020b050d5cf951 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408752:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408758:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408765:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408781:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383320.408791:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408798:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408808:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ffc01425c00) 00010000:00010000:1.0:1787383320.408811:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383320.408814:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408819:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6be00/0x42020b050d5cf958 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408837:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408843:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408848:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408853:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383320.408856:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408861:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408945:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:1.0:1787383320.408948:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383320.408958:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.408965:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf95f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.409085:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11584:x1874206962838144:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 792us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.409096:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:0.0:1787383320.413325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.418347:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962838400 00000100:00100000:2.0:1787383320.418369:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962838400 00000100:00100000:0.0:1787383320.418830:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:0.0:1787383320.418847:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+60:11584:x1874206962838400:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383320.418908:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383320.418936:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf966 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b466 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419080:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419098:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419113:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383320.419128:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787383320.419259:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419267:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419296:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419303:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383320.419309:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419665:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419682:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:0.0:1787383320.419685:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383320.419690:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419698:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cf96d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419751:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf966 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b466 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419761:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:0.0:1787383320.419763:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383320.419776:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cf966 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b466 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.419786:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047400, rc 0) 00000100:00100000:0.0:1787383320.419903:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962838400:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1062us (6604us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787383320.419924:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:0.0:1787383320.423792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.423933:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962838528 00000100:00100000:1.0:1787383320.423948:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962838528 00000100:00100000:1.0:1787383320.424032:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:1.0:1787383320.424045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962838528:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787383320.424097:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787383320.424236:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962838528:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 193us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.424245:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:0.0:1787383320.426862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.427121:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962838784 00000100:00100000:2.0:1787383320.427135:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962838784 00000100:00100000:2.0:1787383320.427204:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:2.0:1787383320.427215:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962838784:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.427242:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383320.427246:0:8068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787383320.427285:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cf90b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b44a expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.427311:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383320.427327:0:8068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383320.427344:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cf97b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b46d expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383320.428283:0:8068:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787383320.429291:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cf982 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.429314:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cf982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.429684:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cf982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.431169:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cf97b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b46d expref: 63 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.431210:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cf982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b46d expref: 62 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.431222:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383320.431226:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383320.431230:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519da00, rc 0) 00000100:00100000:2.0:1787383320.431660:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11584:x1874206962838784:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 4442us (4809us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787383320.431673:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:3.0:1787383320.434477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.434552:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839040 00000100:00100000:2.0:1787383320.434567:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839040 00000100:00100000:2.0:1787383320.434705:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:2.0:1787383320.434718:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11584:x1874206962839040:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.435333:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383320.435386:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cf982 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b46d expref: 62 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435410:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5f00) 00010000:00010000:2.0:1787383320.435423:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383320.435465:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435481:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435494:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435509:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435516:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.435522:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436240:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436255:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436262:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436269:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.436286:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436297:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436310:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383320.436659:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383320.436666:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436673:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf990 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436689:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436695:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436702:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436708:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519dc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.436711:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436716:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436726:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3f8efdd7 (ffff9ffc035c5000) 00010000:00010000:2.0:1787383320.436728:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383320.436740:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.436747:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3f8efdd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.437203:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962839040:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 2482us (2747us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383320.437215:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:3.0:1787383320.439214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.439303:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839168 00000100:00100000:2.0:1787383320.439325:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839168 00000100:00100000:2.0:1787383320.439400:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:2.0:1787383320.439412:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+61:11584:x1874206962839168:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.439441:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383320.439485:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf99e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b474 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439532:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439544:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439554:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439668:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf99e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439685:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.439697:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.439700:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383320.439703:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c800, rc 0) 00000100:00100000:2.0:1787383320.439764:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11584:x1874206962839168:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 356us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.439774:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:0.0:1787383320.446218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.450060:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839424 00000100:00100000:1.0:1787383320.450080:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839424 00000100:00100000:1.0:1787383320.450159:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:1.0:1787383320.450168:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+62:11584:x1874206962839424:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383320.450277:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.450299:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.450315:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383320.450699:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787383320.451404:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344665533881ns, next at 345664838725ns, rc = 0 00000004:00010000:1.0:1787383320.451557:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099931e6e reply state 00000000df53150d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.451568:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383320.451702:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+64:11584:x1874206962839424:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1531us (5493us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787383320.451711:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:3.0:1787383320.454081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1787383320.454925:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.454945:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.454954:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.454961:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383320.454967:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.454976:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.454998:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383320.455002:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787383320.455007:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.455340:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b200/0x42020b050d5cf9ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.463504:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839552 00000100:00100000:2.0:1787383320.463529:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839552 00000100:00100000:2.0:1787383320.463618:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:2.0:1787383320.463630:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+63:11584:x1874206962839552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.463665:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383320.463694:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b47b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.463777:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 64 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.463795:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 64 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.463820:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.463823:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383320.463828:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d800, rc 0) 00000100:00100000:2.0:1787383320.463937:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+64:11584:x1874206962839552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 308us (9873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.463968:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:3.0:1787383320.467207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.467493:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839680 00000100:00100000:2.0:1787383320.467507:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839680 00000100:00100000:2.0:1787383320.467602:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1787383320.467615:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2351:x1874206962839680:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787383320.468077:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2351:x1874206962839680:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 463us (885us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787383320.468087:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00080000:3.0:1787383320.468478:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383320.470839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.471777:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962839936 00000100:00100000:1.0:1787383320.471795:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962839936 00000100:00100000:1.0:1787383320.471901:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1787383320.471914:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+64:11584:x1874206962839936:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787383320.472240:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+65:11584:x1874206962839936:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 328us (1423us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787383320.472247:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1787383320.479909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.480038:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840192 00000100:00100000:0.0:1787383320.480053:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840192 00000100:00100000:0.0:1787383320.480143:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:0.0:1787383320.480154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+65:11584:x1874206962840192:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383320.480692:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+65:11584:x1874206962840192:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 536us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.480705:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:3.0:1787383320.482906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.483084:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840320 00000100:00100000:2.0:1787383320.483096:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840320 00000100:00100000:2.0:1787383320.483170:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:2.0:1787383320.483182:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+65:11584:x1874206962840320:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.483211:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383320.483239:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf9ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b482 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483374:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483393:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483407:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383320.483478:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383320.483505:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483539:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cf9ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b482 expref: 67 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483560:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b482 expref: 66 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.483570:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.483574:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383320.483579:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c400, rc 0) 00000100:00100000:2.0:1787383320.483665:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+66:11584:x1874206962840320:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 484us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.483677:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:3.0:1787383320.487084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.487200:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840448 00000100:00100000:1.0:1787383320.487214:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840448 00000100:00100000:1.0:1787383320.487293:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1787383320.487305:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+10:2348:x1874206962840448:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383320.487330:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383320.487360:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b489 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383320.487394:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e19, blocks: 0x1 00010000:00010000:1.0:1787383320.487419:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1787383320.487424:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383320.487435:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 11 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.487490:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 11 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.487507:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b800, rc 0) 00000100:00100000:1.0:1787383320.487590:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:2348:x1874206962840448:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 287us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.487598:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1787383320.495834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.496003:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840704 00000100:00100000:2.0:1787383320.496016:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840704 00000100:00100000:2.0:1787383320.496098:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:2.0:1787383320.496110:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+66:11584:x1874206962840704:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383320.496253:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+66:11584:x1874206962840704:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 145us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.496262:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:3.0:1787383320.502508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.502633:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840832 00000100:00100000:1.0:1787383320.502648:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840832 00000100:00100000:1.0:1787383320.502723:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1787383320.502736:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3505e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:11584:x1874206962840832:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383320.502762:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383320.502788:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b490 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.502831:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 12 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.502843:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383320.502848:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383320.502855:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.502959:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 12 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.502986:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 12 pid: 6601 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.503004:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979601408:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383320.503144:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0ccbb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383320.518806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.518986:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962840960 00000100:00100000:0.0:1787383320.519000:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962840960 00010000:00010000:0.0:1787383320.519067:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 13 pid: 6601 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.519134:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1787383320.519146:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2348:x1874206962840960:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383320.519168:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383320.519200:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 13 pid: 6601 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.519218:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 13 pid: 6601 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.519254:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383320.519259:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383320.519281:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 13 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.519316:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 13 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.519367:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 13 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.519385:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979601536:192.168.202.19@tcp:105: 00000100:00100000:0.0:1787383320.519505:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6d000 going to sleep for 11 seconds 00010000:00010000:1.0:1787383320.524002:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000122dfe3c/0x42020b050d5cf9c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b489 expref: 13 pid: 6601 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.524052:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874206979601408:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383320.524331:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.524354:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6bc00, rc 0) 00000100:00100000:1.0:1787383320.524532:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3505e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+12:11584:x1874206962840832:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 21797us (22039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.524543:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1787383320.535003:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5790:1874206979601536:192.168.202.19@tcp:105: 00010000:00010000:1.0:1787383320.535058:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383320.535201:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:2348:x1874206962840960:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 16056us (16409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.535236:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:3.0:1787383320.535999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.537501:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841088 00000100:00100000:0.0:1787383320.537521:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841088 00002000:00100000:0.0:1787383320.537600:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ffc171b5500 x1874206962841088/t0(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:106/0 lens 504/0 e 0 to 0 dl 1787383331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383320.537615:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc171b5500 with x1874206962841088 ext(0->12) 00002000:00010000:0.0:1787383320.537621:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc171b5500 00000100:00100000:0.0:1787383320.537655:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1787383320.537666:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+11:2349:x1874206962841088:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787383320.538416:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962841088:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 739us (2410us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787383320.538430:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00002000:00100000:0.0:1787383320.538441:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ffc171b5500 x1874206962841088/t4294967320(0) o4->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:106/0 lens 504/448 e 0 to 0 dl 1787383331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383320.538462:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc171b5500 with x1874206962841088 ext(0->12) 00002000:00010000:0.0:1787383320.538470:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc171b5500 00000100:00100000:2.0:1787383320.540497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.540631:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841216 00000100:00100000:1.0:1787383320.540645:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841216 00000100:00100000:1.0:1787383320.540726:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:1.0:1787383320.540738:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+66:11584:x1874206962841216:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787383320.610156:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:0.0:1787383320.610206:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787383320.610215:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787383320.610314:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787383320.610333:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc0985e6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787383320.610339:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc2d1b0e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc0985e240 00000020:00080000:0.0:1787383320.610342:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc2d1b0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc1897e000 00000004:00080000:0.0:1787383320.610371:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787383320.610404:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc3fc2ac00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787383320.610408:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc08b8bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc3fc2a900 00000020:00080000:0.0:1787383320.610411:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc1e26b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc34d97800 00000020:00080000:0.0:1787383320.610419:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1787383320.610679:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383320.610706:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979601664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787383320.611011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383320.611223:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979601792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787383320.611254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383320.611301:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979601664 00000100:00100000:2.0:1787383320.611312:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979601664 00000100:00100000:2.0:1787383320.611381:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979601792 00000100:00100000:2.0:1787383320.611385:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979601792 00000100:00100000:2.0:1787383320.611411:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383320.611421:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979601664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787383320.611466:0:6600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787383320.611503:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.611533:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.611545:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787383320.611551:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383320.611556:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.611596:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.611614:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 12 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.611648:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979601920:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383320.611726:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ae40 going to sleep for 11 seconds 00000100:00080000:2.0:1787383320.611743:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383320.611760:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383320.611769:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874206979601792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787383320.612410:0:6601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787383320.612417:0:6601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787383321 00002000:00010000:2.0:1787383320.612420:0:6601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787383320.612422:0:6601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787383321 -> 1787383321 00002000:00010000:2.0:1787383320.612425:0:6601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787383320.612550:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1874206979601792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 780us (1292us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787383320.612559:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383320.612789:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979602048:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787383320.612790:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787383320.613040:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787383320.613178:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11584:x1874206962841216:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 72434us (72691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.613190:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:2.0:1787383320.613228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383320.613288:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979602048 00000100:00100000:2.0:1787383320.613296:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979602048 00000100:00100000:2.0:1787383320.613357:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787383320.613368:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979602048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787383320.613392:0:6601:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787383320.613427:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a894e17, atime: 0x6a894e17, ctime: 0x6a894e17, blocks: 0xb 00010000:00010000:2.0:1787383320.613437:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.613492:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787383320.613497:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383320.613506:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.613523:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.613534:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.613542:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.613569:0:6601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383320.613902:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383320.613914:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.613927:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519cc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383320.613947:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.613960:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.613984:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.613992:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6bca484/0x42020b050d5cf9dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.614014:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.614016:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.614017:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787383320.617218:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc37fb6a00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787383320.617239:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979601792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787383320.617326:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979602048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3957us (4100us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787383320.617338:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383320.617429:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787383320.617436:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffb029ace00, transno 4294967307 00000004:00080000:1.0:1787383320.617497:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1787383320.617528:0:3313:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffc171b6a00 x1874206979602048/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383336 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787383320.617540:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc171b6a00/2, rc 0, transno 4294967310 00000100:00080000:3.0:1787383320.617983:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383320.618124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.618152:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841344 00000100:00100000:2.0:1787383320.618160:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841344 00000100:00100000:2.0:1787383320.618214:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1787383320.618228:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962841344:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787383320.618283:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979601920:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383320.618322:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.618343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.618370:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841472 00000100:00100000:2.0:1787383320.618385:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841472 00010000:00010000:2.0:1787383320.618411:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 14 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.627322:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:2.0:1787383320.627362:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+14:2349:x1874206962841472:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787383320.634921:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979602048:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787383320.638124:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383320.638159:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 14 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.638187:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 14 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.644814:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007008655/0x42020b050d5cf798 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3ef expref: 14 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.644854:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383320.644858:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383320.644866:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.644893:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.654178:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383320.654291:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+13:2349:x1874206962841472:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 26934us (35939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.654307:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00010000:00010000:2.0:1787383320.654886:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.654929:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.654942:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.654951:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.654980:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383320.656689:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383320.656708:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.656750:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519dc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383320.656757:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.656770:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.656799:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.656807:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd705452/0x42020b050d5cf9d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.657226:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.657229:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.657231:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383320.659425:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1874206979601664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47991us (48400us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787383320.659441:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787383320.659529:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc37fb4a80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787383320.659537:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979601664:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787383320.736326:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1787383320.736354:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1787383320.736671:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962841344:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 118439us (118544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.736683:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:3.0:1787383320.739258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.739389:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841728 00000100:00100000:2.0:1787383320.739479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841728 00000100:00100000:2.0:1787383320.739605:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:2.0:1787383320.739692:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11584:x1874206962841728:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.739749:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383320.739800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b482 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.739821:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.739840:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383320.739938:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.739952:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.739961:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383320.740368:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003618bb77 reply state 0000000066532e95 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.740380:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383320.740584:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:11584:x1874206962841728:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 895us (1334us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787383320.740593:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 228 00010000:00010000:1.0:1787383320.744359:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744378:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744388:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744394:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519de00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383320.744407:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744416:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744467:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:1.0:1787383320.744471:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383320.744477:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.744485:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5cf9e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.747820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.748179:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962841856 00000100:00100000:2.0:1787383320.748191:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962841856 00000100:00100000:2.0:1787383320.748261:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1787383320.748273:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2351:x1874206962841856:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787383320.748535:0:11924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787383320.748540:0:11924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787383321 -> 1787383320 00002000:00010000:2.0:1787383320.748543:0:11924:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787383319 00002000:00010000:2.0:1787383320.748545:0:11924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787383321 -> 1787383320 00002000:00010000:2.0:1787383320.748547:0:11924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787383320.748779:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2351:x1874206962841856:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 507us (967us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787383320.748789:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1787383320.757248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.757385:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842112 00000100:00100000:2.0:1787383320.757396:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842112 00000100:00100000:2.0:1787383320.757515:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1787383320.757526:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11584:x1874206962842112:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787383320.757722:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.757742:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.757753:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.757789:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.757803:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 20 pid: 5803 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.757818:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979602176:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383320.758052:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383320.762840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.762987:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842240 00000100:00100000:0.0:1787383320.763006:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842240 00010000:00010000:0.0:1787383320.763055:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 21 pid: 5803 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.763100:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:0.0:1787383320.763110:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:2349:x1874206962842240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383320.763135:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383320.763142:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 21 pid: 5803 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.763170:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 21 pid: 5803 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.763193:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:0.0:1787383320.763198:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.763207:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.763215:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.763236:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383320.763301:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:2349:x1874206962842240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 191us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.763308:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00010000:00010000:3.0:1787383320.764558:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c800/0x42020b050d5cf9a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b474 expref: 20 pid: 5803 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.764582:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979602176:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383320.764758:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.764848:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.764855:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765215:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765231:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765687:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765699:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.765703:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765711:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765729:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.765732:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787383320.765737:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.765744:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cf9eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.765835:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11584:x1874206962842112:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 8309us (8594us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787383320.765845:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1787383320.771322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.771420:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842368 00000100:00100000:3.0:1787383320.771431:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842368 00000100:00100000:3.0:1787383320.771505:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1787383320.771516:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962842368:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787383320.771563:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.771582:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.771591:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383320.771595:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383320.771600:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.771766:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.771781:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 8 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.771797:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979602304:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383320.771903:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383320.779088:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6600:1874206979602304:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383320.779245:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.782231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.782433:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842496 00000100:00100000:3.0:1787383320.782444:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842496 00010000:00010000:3.0:1787383320.782496:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 9 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.782543:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1787383320.782553:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+9:2349:x1874206962842496:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383320.782570:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383320.782596:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 9 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.782624:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 9 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.782650:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031b06cb3/0x42020b050d5cf9cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b490 expref: 9 pid: 6599 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.782668:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383320.782673:0:8310:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383320.782679:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.782710:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.782747:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383320.782814:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2349:x1874206962842496:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 261us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.782823:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00010000:00010000:0.0:1787383320.783916:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.783931:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.783972:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.783983:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.784022:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.784029:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383320.784033:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.784042:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.784060:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.784067:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cf9f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.784153:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962842368:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 12636us (12840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.784162:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1787383320.789005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.789354:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842752 00000100:00100000:1.0:1787383320.789365:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842752 00000100:00100000:1.0:1787383320.789431:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:1.0:1787383320.789443:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0512d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11584:x1874206962842752:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383320.789535:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789556:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789570:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789785:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789797:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789806:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789857:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.789904:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 20 pid: 5803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.789921:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979602432:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383320.790358:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0985ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383320.794306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.794335:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962842880 00000100:00100000:0.0:1787383320.794345:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962842880 00010000:00010000:0.0:1787383320.794383:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 21 pid: 5803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.794444:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:0.0:1787383320.794475:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:2348:x1874206962842880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383320.794493:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383320.794499:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 21 pid: 5803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.794512:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 21 pid: 5803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.794535:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:0.0:1787383320.794541:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.794550:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.794557:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.794575:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383320.794631:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:2348:x1874206962842880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 158us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.794638:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00010000:00010000:1.0:1787383320.796044:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cf9b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b47b expref: 20 pid: 5803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383320.796068:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979602432:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383320.796091:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.796100:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383320.796107:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383320.796331:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787383320.796501:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787383320.796548:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787383320.797089:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979602560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383320.797483:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383320.797561:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383320.805154:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979602560 00000100:00100000:3.0:1787383320.805172:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979602560 00000100:00100000:2.0:1787383320.805377:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383320.805388:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1874206979602560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787383320.805562:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1874206979602560:12345-0@lo:1000:mdt00_002.0 Request processed in 175us (8078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.805570:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383320.805890:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787383320.805898:0:5805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787383320.805924:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc37fb6a00, transno 4294967321 00000100:00100000:3.0:1787383320.805945:0:5805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffc37fb4a80 x1874206979601664/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383336 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383320.806129:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979602560:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787383320.806843:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787383320.807710:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c868380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979602688:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787383320.807775:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383320.807817:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ca6d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383320.807915:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979602688 00000100:00100000:0.0:1787383320.807923:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979602688 00000100:00100000:0.0:1787383320.808214:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383320.808226:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1874206979602688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787383320.808555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5805:x1874206979602688:12345-0@lo:1000:mdt00_002.0 Request processed in 330us (777us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787383320.809715:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c868380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1874206979602688:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787383320.809841:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787383320.809984:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.809997:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810005:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810011:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.810015:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810197:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810223:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.810226:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383320.810231:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810237:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b600/0x42020b050d5cfa00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810272:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810277:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810291:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810295:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.810298:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810304:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810312:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383320.810315:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383320.810323:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810334:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810349:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.810390:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.810519:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979602816:192.168.202.19@tcp:105: 00000100:00100000:2.0:1787383320.810605:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc277243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383320.816550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.816639:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962843008 00000100:00100000:3.0:1787383320.816648:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962843008 00000100:00100000:3.0:1787383320.816706:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1787383320.816716:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11583:x1874206962843008:12345-192.168.202.19@tcp:49:lfs.0 00000100:00100000:3.0:1787383320.816895:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11583:x1874206962843008:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 180us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.816904:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1787383320.822999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.823353:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962843264 00000100:00100000:3.0:1787383320.823365:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962843264 00000100:00100000:3.0:1787383320.823435:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:3.0:1787383320.823456:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11583:x1874206962843264:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:3.0:1787383320.824189:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787383320.824298:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+24:11583:x1874206962843264:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 851us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.824309:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1787383320.825578:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1874206979602816:192.168.202.19@tcp:105: 00010000:00010000:2.0:1787383320.826254:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826269:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cf943 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826306:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826320:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826331:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826343:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826350:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826356:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826362:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.826366:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826374:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826384:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383320.826387:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383320.826474:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826483:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826494:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826500:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826506:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826510:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.826513:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826519:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826527:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383320.826529:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383320.826532:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.826537:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6a800/0x42020b050d5cf9f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.827178:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0512d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:11584:x1874206962842752:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 37732us (38179us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787383320.827189:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 230 00000020:00080000:2.0:1787383320.827204:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787383320.831588:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383320.831597:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383320.831647:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787383320.831654:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383320.831811:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979602944:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787383320.831941:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383320.840299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.840485:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1874206979602944:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383320.845514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.846756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962843648 00000100:00100000:3.0:1787383320.846770:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962843648 00000100:00100000:3.0:1787383320.846839:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1787383320.846850:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:11584:x1874206962843648:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787383320.848951:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787383320.849107:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787383320.849197:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849214:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849228:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849237:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849244:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849251:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383320.849285:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383320.849485:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383320.849493:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.849501:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383320.849506:0:11031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.849515:0:11031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.849539:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffc0a060800) 00010000:00010000:3.0:1787383320.849542:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383320.849547:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.849553:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047400/0x42020b050d5cfa0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.849571:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.849573:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383320.849575:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383320.850702:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:11584:x1874206962843648:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 3841us (5187us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787383320.850717:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000020:00080000:0.0:1787383320.850726:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787383320.855279:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962843392 00000100:00100000:2.0:1787383320.855297:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962843392 00000100:00100000:2.0:1787383320.855391:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1787383320.855410:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:11585:x1874206962843392:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383320.855453:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383320.860049:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:11585:x1874206962843392:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 2463us (17572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.860067:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:0.0:1787383320.876838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383320.877033:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962843776 00000100:00100000:2.0:1787383320.877044:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962843776 00000100:00100000:2.0:1787383320.877103:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1787383320.877114:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+25:11587:x1874206962843776:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383320.877148:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383320.877171:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b497 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877246:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877262:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877274:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877323:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877331:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877348:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877686:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877699:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 26 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877708:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877743:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 26 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.877756:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 26 pid: 8068 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383320.877770:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979603072:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383320.877857:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27724240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383320.879291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383320.879486:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962844032 00000100:00100000:3.0:1787383320.879497:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962844032 00000100:00100000:3.0:1787383320.879554:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:3.0:1787383320.879565:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+27:11585:x1874206962844032:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383320.879584:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383320.879603:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cfa31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b49e expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879710:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cfa38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879725:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cfa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879736:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cfa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383320.879748:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787383320.879932:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cfa31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b49e expref: 30 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879962:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cfa38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b49e expref: 29 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879972:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383320.879975:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383320.879979:0:8068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879987:0:8068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.879993:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:3.0:1787383320.880049:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:11585:x1874206962844032:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 486us (767us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787383320.880057:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:0.0:1787383320.890423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.890475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.891307:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962844288 00000100:00100000:1.0:1787383320.891319:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962844288 00000100:00100000:1.0:1787383320.891384:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1787383320.891394:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+29:5560:x1874206962844288:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787383320.891691:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:5560:x1874206962844288:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 298us (1279us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787383320.891700:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1787383320.891971:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962844544 00000100:00100000:3.0:1787383320.891977:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962844544 00000100:00100000:3.0:1787383320.892009:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 235 00000100:00100000:3.0:1787383320.892017:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:11585:x1874206962844544:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787383320.892073:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892092:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892103:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892301:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892310:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892318:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892325:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383320.892330:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892338:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892350:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383320.892354:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383320.892359:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.892364:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98a00/0x42020b050d5cfa46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.892511:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:11585:x1874206962844544:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 493us (2034us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787383320.892520:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 235 00000040:00080000:3.0:1787383320.892647:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383320.892652:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383320.893116:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787383320.895558:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787383320.902250:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1874206979603072:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383320.902299:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383320.902969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383320.903008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383320.903267:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962844928 00000100:00100000:1.0:1787383320.903275:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962844928 00000100:00100000:1.0:1787383320.903338:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1787383320.903348:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:11585:x1874206962844928:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787383320.903614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11585:x1874206962844928:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 267us (604us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787383320.903623:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1787383320.903760:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962844672 00000100:00100000:3.0:1787383320.903766:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962844672 00010000:00010000:3.0:1787383320.903791:0:8310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 32 pid: 8068 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383320.903831:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1787383320.903839:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:2348:x1874206962844672:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383320.903847:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383320.903854:0:8310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 32 pid: 8068 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903896:0:8310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 32 pid: 8068 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903920:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6b000/0x42020b050d5cf935 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b458 expref: 32 pid: 8068 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903935:0:8310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383320.903940:0:8310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903949:0:8310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903957:0:8310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383320.903987:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383320.904036:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+31:2348:x1874206962844672:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 197us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.904042:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00010000:00010000:2.0:1787383320.904276:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904285:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383320.904329:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787383320.904334:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383320.904352:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904365:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904376:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904383:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904390:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904396:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.904399:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904407:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904417:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:2.0:1787383320.904420:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383320.904424:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904431:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904463:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904470:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904475:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904481:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383320.904483:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904489:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904498:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffc035c5500) 00010000:00010000:2.0:1787383320.904500:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383320.904504:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904510:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cfa23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904545:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c400/0x42020b050d5cfa15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b497 expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904558:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b497 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383320.904577:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383320.904580:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383320.904582:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d000, rc 0) 00000100:00100000:2.0:1787383320.904611:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:11587:x1874206962843776:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 27499us (27784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.904618:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:0.0:1787383321.074586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383321.074646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383321.074660:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845184 00000100:00100000:1.0:1787383321.074672:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845184 00000100:00100000:1.0:1787383321.074732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:1.0:1787383321.074743:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:2349:x1874206962845184:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383321.074751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383321.074753:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845440 00000100:00100000:3.0:1787383321.074759:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845440 00000100:00100000:0.0:1787383321.074779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383321.074806:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845312 00000100:00100000:0.0:1787383321.074810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383321.074811:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845312 00000100:00100000:3.0:1787383321.074844:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1787383321.074845:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:2349:x1874206962845184:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383321.074851:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:1.0:1787383321.074862:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:0.0:1787383321.074863:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962845312:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383321.074890:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962845440:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383321.074911:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845568 00000100:00100000:1.0:1787383321.074915:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845568 00000100:00100000:0.0:1787383321.074918:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962845312:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383321.074926:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1787383321.074932:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb025ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962845440:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383321.074941:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1787383321.074946:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:1.0:1787383321.074954:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962845568:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383321.074971:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845056 00000100:00100000:3.0:1787383321.074976:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845056 00000100:00100000:1.0:1787383321.074986:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2349:x1874206962845568:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383321.075005:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:3.0:1787383321.075021:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 297 00000100:00100000:3.0:1787383321.075032:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962845056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383321.075073:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962845056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383321.075082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 297 00000100:00080000:3.0:1787383321.075123:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383321.075128:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787383321.424026:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383321.900686:0:12421:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383321.900701:0:12421:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383321.900832:0:12421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787383321.900841:0:12421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383322.117389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383322.117427:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845824 00000100:00100000:0.0:1787383322.117448:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845824 00000100:00100000:0.0:1787383322.117518:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 236 00000100:00100000:0.0:1787383322.117531:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+30:11610:x1874206962845824:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383322.117552:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383322.117574:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cfa4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4a5 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383322.117688:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cfa54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383322.117704:0:8068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cfa54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383322.117716:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cfa54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383322.117727:0:8068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787383322.117855:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cfa4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4a5 expref: 33 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383322.117893:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cfa54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4a5 expref: 32 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383322.117903:0:8068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:0.0:1787383322.117906:0:8068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787383322.117910:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046a00, rc 0) 00000100:00100000:0.0:1787383322.117966:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11610:x1874206962845824:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 438us (584us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787383322.117975:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 236 00000100:00080000:0.0:1787383322.117998:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383322.122730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383322.122801:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962845952 00000100:00100000:2.0:1787383322.122812:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962845952 00000100:00100000:2.0:1787383322.122905:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00100000:2.0:1787383322.122916:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11610:x1874206962845952:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1787383322.122996:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123027:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123041:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123071:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123078:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123085:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123092:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383322.123109:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123117:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123129:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:2.0:1787383322.123133:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383322.123137:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.123502:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cfa62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383322.123579:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+32:11610:x1874206962845952:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 664us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383322.123587:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00100000:0.0:1787383322.249765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383322.253749:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846080 00000100:00100000:2.0:1787383322.253765:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846080 00000100:00100000:2.0:1787383322.253856:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1787383322.253904:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2348:x1874206962846080:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383322.253921:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383322.253946:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac42fad/0x42020b050d5cfa69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4ac expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383322.253975:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a894e18, atime: 0x6a894e17, ctime: 0x6a894e18, blocks: 0xb 00010000:00010000:2.0:1787383322.253998:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1787383322.254003:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383322.254013:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac42fad/0x42020b050d5cfa69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4ac expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.254051:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ac42fad/0x42020b050d5cfa69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4ac expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383322.254065:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c200, rc 0) 00000100:00100000:2.0:1787383322.254124:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962846080:12345-192.168.202.19@tcp:101:cat.0 Request processed in 259us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383322.254130:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00080000:0.0:1787383322.254246:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383322.260161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383322.260267:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846208 00000100:00100000:2.0:1787383322.260278:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846208 00002000:00100000:2.0:1787383322.260331:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ffc3c93f480 x1874206962846208/t0(0) o3->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:108/0 lens 488/0 e 0 to 0 dl 1787383333 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383322.260342:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc3c93f480 with x1874206962846208 ext(0->4095) 00002000:00010000:2.0:1787383322.260348:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc3c93f480 00000100:00100000:2.0:1787383322.260379:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1787383322.260389:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962846208:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:2.0:1787383322.260610:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+8:2348:x1874206962846208:12345-192.168.202.19@tcp:3:cat.0 Request processed in 221us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787383322.260619:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00002000:00100000:2.0:1787383322.260626:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ffc3c93f480 x1874206962846208/t0(0) o3->c5843774-e16e-46d1-9ea7-9bdf9153dca9@192.168.202.19@tcp:108/0 lens 488/4536 e 0 to 0 dl 1787383333 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383322.260635:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc3c93f480 with x1874206962846208 ext(0->4095) 00002000:00010000:2.0:1787383322.260639:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc3c93f480 00010000:00010000:3.0:1787383322.442210:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383322.893051:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979603200:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893130:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893175:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979603712:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893229:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383322.893236:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979603328:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893272:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979603840:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893295:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893320:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979603584:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893359:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383322.893364:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979603456:0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893382:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383322.893407:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603200 00000100:00100000:1.0:1787383322.893420:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603200 00000100:00100000:1.0:1787383322.893475:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787383322.893484:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383322.893535:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979603200:12345-0@lo:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383322.893542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787383322.893685:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603712 00000100:00100000:0.0:1787383322.893690:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603712 00000100:00100000:0.0:1787383322.893733:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603328 00000100:00100000:0.0:1787383322.893736:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603328 00000100:00100000:0.0:1787383322.893748:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603456 00000100:00100000:0.0:1787383322.893751:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603456 00000100:00100000:0.0:1787383322.893767:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787383322.893774:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979603712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.893811:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979603712:12345-0@lo:400:kworker.0 Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383322.893817:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787383322.893833:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787383322.893839:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979603328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.893863:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979603328:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383322.893885:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787383322.893897:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787383322.893903:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.893935:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979603456:12345-0@lo:400:kworker.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383322.893942:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1787383322.893963:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383322.893992:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979603456:0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.894055:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979603328:0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.894065:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979603200:0@lo:400:kworker.0 00000100:00100000:0.0:1787383322.894075:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979603712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383322.894425:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603840 00000100:00100000:3.0:1787383322.894492:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603840 00000100:00100000:3.0:1787383322.894532:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603584 00000100:00100000:3.0:1787383322.894536:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603584 00000100:00100000:3.0:1787383322.894574:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787383322.894591:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979603840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383322.894637:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874206979603840:12345-0@lo:400:kworker.0 Request processed in 48us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383322.894644:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787383322.894657:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787383322.894663:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874206979603584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383322.894698:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874206979603584:12345-0@lo:400:kworker.0 Request processed in 34us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383322.894704:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787383322.894732:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383322.894735:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383322.894757:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979603584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383322.894786:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979603840:0@lo:400:kworker.0 00000040:00080000:2.0:1787383322.955207:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383322.955223:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787383322.955261:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787383322.955267:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383323.402438:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc05151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979603968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383323.402535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383323.404952:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979603968 00000100:00100000:2.0:1787383323.404970:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979603968 00000100:00100000:2.0:1787383323.405046:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383323.405058:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979603968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383323.405117:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383323.414378:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874206979603968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9306us (11826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383323.414397:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787383323.417714:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc05151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979603968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383323.473754:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383323.915519:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979604096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383323.915621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383323.915990:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604096 00000100:00100000:2.0:1787383323.916003:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604096 00000100:00100000:2.0:1787383323.916082:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383323.916094:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874206979604096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383323.916141:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383323.916194:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874206979604096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383323.916202:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787383323.916299:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979604096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383324.491371:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787383325.024619:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1787383325.514163:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787383326.084342:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787383326.084447:0:5826:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc3ca6da80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787383326.084453:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc3ff5c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc3ca6df00 00000020:00080000:0.0:1787383326.084456:0:5826:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9ffc3ff5c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc0ccad000 00000020:00080000:0.0:1787383326.084473:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787383326.085829:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787383326.086115:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787383326.142909:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787383326.143257:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1787383326.193452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383326.193504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383326.193600:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846464 00000100:00100000:0.0:1787383326.193612:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846464 00000100:00100000:0.0:1787383326.193700:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:0.0:1787383326.193712:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962846464:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383326.193796:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962846464:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383326.193803:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00080000:1.0:1787383326.193979:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383326.194070:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846336 00000100:00100000:3.0:1787383326.194075:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846336 00000100:00100000:3.0:1787383326.194111:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 299 00000100:00100000:3.0:1787383326.194119:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962846336:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383326.194365:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962846336:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 246us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383326.194373:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 299 00000100:00100000:1.0:1787383326.202092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383326.202133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383326.202207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383326.202297:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846848 00000100:00100000:0.0:1787383326.202307:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846848 00000100:00100000:0.0:1787383326.202371:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:0.0:1787383326.202380:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962846848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383326.202466:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2348:x1874206962846848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383326.202474:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00080000:1.0:1787383326.202601:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383326.202663:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846592 00000100:00100000:2.0:1787383326.202668:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846592 00000100:00100000:2.0:1787383326.202711:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846720 00000100:00100000:2.0:1787383326.202714:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846720 00000100:00100000:2.0:1787383326.202736:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1787383326.202743:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962846592:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383326.202777:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962846592:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383326.202796:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1787383326.202812:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:2.0:1787383326.202817:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962846720:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383326.202839:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2348:x1874206962846720:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383326.202845:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00080000:1.0:1787383326.202902:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383326.202905:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787383326.538557:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383327.562398:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383327.573847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383327.574122:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962846976 00000100:00100000:0.0:1787383327.574196:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962846976 00000100:00100000:0.0:1787383327.574297:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:0.0:1787383327.574308:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11263:x1874206962846976:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787383327.574479:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11263:x1874206962846976:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 171us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383327.574487:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:3.0:1787383327.577190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383327.577230:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847232 00000100:00100000:3.0:1787383327.577238:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847232 00000100:00100000:3.0:1787383327.577287:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1787383327.577296:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:11263:x1874206962847232:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787383327.578097:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:11263:x1874206962847232:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 796us (911us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787383327.578108:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1787383327.944910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383327.945150:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847360 00000100:00100000:0.0:1787383327.945163:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847360 00000100:00100000:0.0:1787383327.945244:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00100000:0.0:1787383327.945266:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:12062:x1874206962847360:12345-192.168.202.19@tcp:101:lsof.0 00010000:00010000:0.0:1787383327.945292:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383327.945324:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cfa70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4b3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945429:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945444:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945459:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383327.945686:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787383327.945691:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383327.945779:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945809:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cfa70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4b3 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945828:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4b3 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383327.945844:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:0.0:1787383327.945847:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383327.945851:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383327.947687:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:12062:x1874206962847360:12345-192.168.202.19@tcp:101:lsof.0 Request processed in 2422us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383327.947701:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00100000:2.0:1787383328.011276:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383328.013467:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383328.013498:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979604352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383328.013576:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383328.013818:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604352 00000100:00100000:0.0:1787383328.013828:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604352 00000100:00100000:0.0:1787383328.013899:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787383328.013907:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.013959:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979604352:12345-0@lo:400:kworker.0 Request processed in 53us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383328.013965:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787383328.014044:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979604352:0@lo:400:kworker.0 00000100:00100000:2.0:1787383328.015241:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979604224:0@lo:400:kworker.0 00000100:00100000:2.0:1787383328.015302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383328.018852:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979604480:0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.018944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383328.018996:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383328.019003:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979604608:0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.019031:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383328.019073:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604608 00000100:00100000:3.0:1787383328.019081:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604608 00000100:00100000:3.0:1787383328.019144:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787383328.019154:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979604608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.019206:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979604608:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383328.019214:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1787383328.019236:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383328.019252:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604480 00000100:00100000:3.0:1787383328.019255:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604480 00000100:00100000:3.0:1787383328.019284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787383328.019291:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979604480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.019323:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979604480:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383328.019346:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1787383328.019360:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383328.019399:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787383328.019404:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc37fb4a80, transno 4294967322 00000004:00080000:3.0:1787383328.019416:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787383328.019443:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979604608:0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.019455:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979604480:0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020007:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979604736:0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383328.020081:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383328.020088:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979604864:0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383328.020144:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604864 00000100:00100000:0.0:1787383328.020150:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604864 00000100:00100000:0.0:1787383328.020189:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787383328.020198:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979604864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020239:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979604864:12345-0@lo:400:kworker.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383328.020245:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787383328.020279:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383328.020298:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787383328.020302:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc171b6a00, transno 4294967310 00000100:00100000:0.0:1787383328.020312:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979604864:0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020330:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604736 00000100:00100000:0.0:1787383328.020334:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604736 00000100:00100000:0.0:1787383328.020365:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787383328.020372:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979604736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383328.020419:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979604736:12345-0@lo:400:kworker.0 Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383328.020425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1787383328.020437:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383328.020458:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979604736:0@lo:400:kworker.0 00000100:00100000:1.0:1787383328.020674:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604224 00000100:00100000:1.0:1787383328.020681:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604224 00000100:00100000:1.0:1787383328.020733:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787383328.020741:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979604224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383328.020781:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979604224:12345-0@lo:400:kworker.0 Request processed in 42us (5479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383328.020788:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787383328.021234:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979604224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383328.522486:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979604992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383328.522581:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383328.522787:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979604992 00000100:00100000:2.0:1787383328.522797:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979604992 00000100:00100000:2.0:1787383328.522852:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383328.522862:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979604992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383328.522922:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383328.523218:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979604992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 356us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383328.523228:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383328.523332:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979604992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787383328.588069:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383329.036792:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383329.036903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383329.037281:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605120 00000100:00100000:2.0:1787383329.037291:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605120 00000100:00100000:2.0:1787383329.037353:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787383329.037363:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979605120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383329.037433:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787383329.037495:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979605120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383329.037521:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787383329.037660:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979605120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787383329.611212:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383330.636664:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787383331.149331:0:5826:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1787383331.149373:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787383331.149530:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787383331.149541:0:5837:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787383331.311428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383331.311530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383331.311582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383331.311617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383331.311644:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847488 00000100:00100000:3.0:1787383331.311648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383331.311662:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847488 00000100:00100000:3.0:1787383331.311677:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847872 00000100:00100000:3.0:1787383331.311680:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847872 00000100:00100000:3.0:1787383331.311722:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847744 00000100:00100000:3.0:1787383331.311725:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847744 00000100:00100000:1.0:1787383331.311727:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:1.0:1787383331.311738:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962847488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383331.311746:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1787383331.311752:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962847872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383331.311846:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1787383331.311858:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962847744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383331.312004:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962847616 00000100:00100000:2.0:1787383331.312008:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962847616 00000100:00100000:2.0:1787383331.312044:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962848000 00000100:00100000:2.0:1787383331.312048:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962848000 00000100:00100000:2.0:1787383331.312077:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:2.0:1787383331.312087:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962847616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383331.312180:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc171b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2349:x1874206962847872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 426us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383331.312180:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962847488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 441us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383331.312188:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:3.0:1787383331.312204:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1787383331.312226:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:3.0:1787383331.312233:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2349:x1874206962848000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383331.312259:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2349:x1874206962848000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383331.312265:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00080000:3.0:1787383331.312290:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383331.312296:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383331.312298:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383331.312419:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2349:x1874206962847744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 564us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383331.312427:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1787383331.312732:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:2349:x1874206962847616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 645us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383331.312741:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00010000:00010000:3.0:1787383331.660964:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383332.036258:0:12627:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:22:10 (1787383330) 00000040:00080000:0.0:1787383332.240736:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383332.240747:0:11544:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383332.241290:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787383332.241303:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787383332.686589:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383333.133455:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979605248:0@lo:400:kworker.0 00000100:00100000:0.0:1787383333.133532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.134991:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979605376:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.135047:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.135097:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605376 00000100:00100000:3.0:1787383333.135105:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605376 00000100:00100000:3.0:1787383333.135150:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787383333.135160:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979605376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.135216:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979605376:12345-0@lo:400:kworker.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383333.135223:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787383333.135266:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979605376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383333.135354:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605248 00000100:00100000:1.0:1787383333.135359:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605248 00000100:00100000:1.0:1787383333.135397:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787383333.135404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979605248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.135816:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.135856:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.135900:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383333.135924:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979605632:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.135953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.135982:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605632 00000100:00100000:3.0:1787383333.135986:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605632 00000100:00100000:3.0:1787383333.136020:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787383333.136027:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979605632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136063:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979605632:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383333.136069:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787383333.136086:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383333.136098:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979605888:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.136139:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383333.136145:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979605760:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383333.136188:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605888 00000100:00100000:3.0:1787383333.136191:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605888 00000100:00100000:3.0:1787383333.136220:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787383333.136225:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979605888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136254:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979605888:12345-0@lo:400:kworker.0 Request processed in 30us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383333.136260:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787383333.136272:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605504 00000100:00100000:3.0:1787383333.136275:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605504 00000100:00100000:3.0:1787383333.136291:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979605760 00000100:00100000:3.0:1787383333.136294:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979605760 00000100:00100000:3.0:1787383333.136306:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787383333.136310:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136365:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979605504:12345-0@lo:400:kworker.0 Request processed in 53us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383333.136372:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787383333.136383:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787383333.136388:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979605760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136414:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979605760:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383333.136419:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1787383333.136438:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383333.136441:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383333.136461:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979605632:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136471:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136502:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc171b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979605760:0@lo:400:kworker.0 00000100:00100000:3.0:1787383333.136511:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979605888:0@lo:400:kworker.0 00000100:00100000:1.0:1787383333.137370:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979605248:12345-0@lo:400:kworker.0 Request processed in 1961us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383333.137383:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787383333.138046:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc0512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979605248:0@lo:400:kworker.0 00000100:00100000:2.0:1787383333.642272:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383333.642298:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979606016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383333.642388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383333.642542:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606016 00000100:00100000:0.0:1787383333.642555:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606016 00000100:00100000:0.0:1787383333.642615:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787383333.642625:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979606016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383333.642674:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787383333.642737:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979606016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383333.642745:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383333.642904:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979606016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787383333.710342:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383334.156694:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383334.156722:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979606144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383334.156807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383334.158301:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606144 00000100:00100000:0.0:1787383334.158314:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606144 00000100:00100000:0.0:1787383334.158390:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787383334.158400:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979606144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383334.158448:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1787383334.158534:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979606144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383334.158542:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787383334.158664:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979606144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383334.730199:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383335.754253:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383336.183375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383336.183486:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962848256 00000100:00100000:0.0:1787383336.183497:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962848256 00000100:00100000:0.0:1787383336.183582:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:0.0:1787383336.183594:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+19:12284:x1874206962848256:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:0.0:1787383336.184417:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:12284:x1874206962848256:12345-192.168.202.19@tcp:35:umount.0 Request processed in 817us (1042us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787383336.184434:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00080000:3.0:1787383336.184712:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383336.189392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383336.189418:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962848512 00000100:00100000:3.0:1787383336.189429:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962848512 00000100:00100000:3.0:1787383336.189496:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:3.0:1787383336.189508:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+20:12284:x1874206962848512:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:3.0:1787383336.189937:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:12284:x1874206962848512:12345-192.168.202.19@tcp:35:umount.0 Request processed in 430us (554us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787383336.193289:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1787383336.194632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383336.194760:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962848768 00000100:00100000:0.0:1787383336.194771:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962848768 00000100:00100000:0.0:1787383336.194835:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1787383336.194847:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc275d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+21:12284:x1874206962848768:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:0.0:1787383336.195335:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc275d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:12284:x1874206962848768:12345-192.168.202.19@tcp:35:umount.0 Request processed in 489us (708us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787383336.195343:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1787383336.198335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383336.198413:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849024 00000100:00100000:3.0:1787383336.198423:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849024 00000100:00100000:3.0:1787383336.198482:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1787383336.198492:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:12284:x1874206962849024:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:3.0:1787383336.198915:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:12284:x1874206962849024:12345-192.168.202.19@tcp:35:umount.0 Request processed in 423us (588us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787383336.198925:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1787383336.206554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383336.206610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383336.206636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383336.206660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383336.206735:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849152 00000100:00100000:3.0:1787383336.206746:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849152 00000100:00100000:3.0:1787383336.206818:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849408 00000100:00100000:3.0:1787383336.206822:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849408 00000100:00100000:3.0:1787383336.206837:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849280 00000100:00100000:3.0:1787383336.206841:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849280 00000100:00100000:3.0:1787383336.206857:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383336.206891:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+15:2349:x1874206962849152:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383336.206909:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383336.206930:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98200/0x42020b050d5ceaef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b03e expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.206949:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383336.207005:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+14:2349:x1874206962849152:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 140us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383336.207013:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383336.207029:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1787383336.207036:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+13:2349:x1874206962849408:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383336.207063:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383336.207073:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6a400/0x42020b050d5ced03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b109 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.207083:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383336.207102:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:2349:x1874206962849408:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 66us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383336.207108:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1787383336.207121:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383336.207127:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:2349:x1874206962849280:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383336.207135:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383336.207144:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01662e00/0x42020b050d5cea55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b006 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.207154:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383336.207171:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2349:x1874206962849280:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383336.207177:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383336.207198:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849536 00000100:00100000:3.0:1787383336.207201:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849536 00000100:00100000:3.0:1787383336.207232:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:3.0:1787383336.207238:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2347:x1874206962849536:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:3.0:1787383336.207262:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cedc7 00000100:00080000:3.0:1787383336.207269:0:6601:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc77000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383336.207314:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787383336.207548:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5843774-e16e-46d1-9ea7-9bdf9153dca9+2:2347:x1874206962849536:12345-192.168.202.19@tcp:9:umount.0 Request processed in 308us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383336.207559:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00010000:00010000:3.0:1787383336.207581:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383336.207590:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383336.220176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383336.220225:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962849920 00000100:00100000:3.0:1787383336.220237:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962849920 00000100:00100000:3.0:1787383336.220375:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1787383336.220385:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+7:2347:x1874206962849920:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:3.0:1787383336.220417:0:11924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cf02f 00000020:00010000:3.0:1787383336.220425:0:11924:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ffc3e58c800: total 0 00000100:00080000:3.0:1787383336.220430:0:11924:0:(import.c:65:import_set_state_nolock()) ffff9ffc3e58b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383336.220471:0:11924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1787383336.220848:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1787383336.221090:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ffc3e58c800: total 0 00000100:00100000:3.0:1787383336.221149:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5843774-e16e-46d1-9ea7-9bdf9153dca9+5:2347:x1874206962849920:12345-192.168.202.19@tcp:9:umount.0 Request processed in 760us (981us total) trans 0 rc 0/0 00010000:00010000:2.0:1787383336.221150:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ffc3e58c800, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1787383336.221161:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00010000:00010000:2.0:1787383336.222971:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac42fad/0x42020b050d5cfa69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4ac expref: 4 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383336.223026:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d79927/0x42020b050d5cf3cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2de expref: 3 pid: 11924 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383336.223040:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ffc3e58c800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787383336.223076:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383336.223078:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383336.223080:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383336.237510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383336.237817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962850944 00000100:00100000:2.0:1787383336.237834:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962850944 00000100:00100000:2.0:1787383336.237986:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 240 00000100:00100000:2.0:1787383336.238000:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+23:2347:x1874206962850944:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:2.0:1787383336.238046:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea63 00000020:00010000:2.0:1787383336.238065:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ffc2c0b0800: total 0 00000100:00080000:2.0:1787383336.238071:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383336.238101:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787383336.238610:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5843774-e16e-46d1-9ea7-9bdf9153dca9+22:2347:x1874206962850944:12345-192.168.202.19@tcp:39:umount.0 Request processed in 610us (1112us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787383336.238619:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 240 00000020:00010000:3.0:1787383336.239071:0:11031:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ffc2c0b0800: total 0 00010000:00010000:3.0:1787383336.239124:0:11031:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ffc2c0b0800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787383336.239169:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383336.239173:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383336.239182:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3dc6aa00/0x42020b050d5ced49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b11e expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239213:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383336.239216:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383336.239221:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5cfa2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b497 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239274:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:3.0:1787383336.239277:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383336.239282:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514400/0x42020b050d5cf42d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2fa expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239295:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383336.239298:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787383336.239302:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046a00/0x42020b050d5cfa54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4a5 expref: 18 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239329:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383336.239331:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383336.239336:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514200/0x42020b050d5cf38c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2c9 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239348:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383336.239350:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787383336.239353:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514000/0x42020b050d5cf3b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b2d7 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239365:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383336.239368:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383336.239371:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046400/0x42020b050d5cf728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b3d3 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239382:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383336.239384:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383336.239395:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99600/0x42020b050d5cf08a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b205 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239409:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc094fe000) 00010000:00010000:3.0:1787383336.239411:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383336.239416:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99e00/0x42020b050d5ced2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b117 expref: 13 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239454:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383336.239457:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383336.239461:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc01514800/0x42020b050d5cf2ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b291 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239474:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffc094fe400) 00010000:00010000:3.0:1787383336.239476:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383336.239480:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5ced9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b133 expref: 11 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239493:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383336.239495:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383336.239499:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cf94a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b45f expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239511:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffc01425700) 00010000:00010000:3.0:1787383336.239514:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383336.239516:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99400/0x42020b050d5cfa38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b49e expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239533:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffc094fe300) 00010000:00010000:3.0:1787383336.239542:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383336.239548:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98e00/0x42020b050d5cf449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b301 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383336.239562:0:11031:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ffc2c0b0800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787383336.239575:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383336.239577:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383336.239579:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787383336.251535:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:3.0:1787383336.251572:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000100:00100000:3.0:1787383336.433285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383336.433442:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851072 00000100:00100000:0.0:1787383336.433457:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851072 00000100:00100000:0.0:1787383336.433556:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00080000:3.0:1787383336.433660:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383336.433687:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2348:x1874206962851072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383336.433802:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2348:x1874206962851072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 236us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.434087:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00010000:00010000:3.0:1787383336.779147:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383337.802229:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383338.250718:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383338.258997:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979606400:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.259132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383338.259224:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606400 00000100:00100000:1.0:1787383338.259237:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606400 00000100:00100000:3.0:1787383338.259305:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979606272:0@lo:400:kworker.0 00000100:00100000:1.0:1787383338.259317:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383338.259331:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979606400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.259347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383338.259406:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979606400:12345-0@lo:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383338.259415:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383338.262257:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979606528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383338.262391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383338.264561:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606528 00000100:00100000:2.0:1787383338.264586:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606528 00000100:00100000:2.0:1787383338.264808:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787383338.264823:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383338.264970:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979606528:12345-0@lo:400:kworker.0 Request processed in 154us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383338.264979:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787383338.265198:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979606656:0@lo:400:kworker.0 00000100:00100000:0.0:1787383338.265248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383338.265682:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383338.265700:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606272 00000100:00100000:3.0:1787383338.265706:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606272 00000100:00100000:3.0:1787383338.265746:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787383338.265753:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979606272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.265814:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979606272:12345-0@lo:400:kworker.0 Request processed in 61us (6467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383338.265820:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787383338.266057:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979606272:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266089:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979606912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383338.266177:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606656 00000100:00100000:3.0:1787383338.266181:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606656 00000100:00100000:3.0:1787383338.266212:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606912 00000100:00100000:3.0:1787383338.266214:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606912 00000100:00100000:3.0:1787383338.266231:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787383338.266237:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979606656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266268:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979606656:12345-0@lo:400:kworker.0 Request processed in 31us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383338.266274:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787383338.266295:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787383338.266301:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979606912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266324:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979606912:12345-0@lo:400:kworker.0 Request processed in 24us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383338.266330:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787383338.266347:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383338.266350:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383338.266368:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979606912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266383:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979606400:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266398:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383338.266404:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979606784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266429:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383338.266453:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979606784 00000100:00100000:3.0:1787383338.266456:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979606784 00000100:00100000:3.0:1787383338.266489:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787383338.266495:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979606784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.266533:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979606784:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383338.266540:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1787383338.266552:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383338.266564:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979606784:0@lo:400:kworker.0 00000100:00100000:1.0:1787383338.268756:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979606528:0@lo:400:kworker.0 00000100:00100000:0.0:1787383338.268757:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979606656:0@lo:400:kworker.0 00000100:00100000:3.0:1787383338.380783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383338.380838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383338.380983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383338.381090:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851200 00000100:00100000:2.0:1787383338.381105:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851200 00000100:00100000:2.0:1787383338.381187:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851456 00000100:00100000:2.0:1787383338.381191:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851456 00000100:00100000:1.0:1787383338.383205:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851328 00000100:00100000:1.0:1787383338.383225:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851328 00000100:00100000:1.0:1787383338.383318:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1787383338.383332:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+12:2351:x1874206962851200:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383338.383361:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383338.383392:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc00031200/0x42020b050d5ceb35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b053 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383338.383418:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383338.383514:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+11:2351:x1874206962851200:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 185us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383338.383559:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1787383338.383650:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1787383338.383659:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+10:2351:x1874206962851456:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383338.383668:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383338.383680:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046e00/0x42020b050d5cecfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b102 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383338.383690:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383338.383710:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+9:2351:x1874206962851456:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 52us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383338.383717:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1787383338.383730:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1787383338.383736:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+8:2351:x1874206962851328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383338.383743:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383338.383753:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc00031400/0x42020b050d5ceb3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b07d expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383338.383761:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383338.383778:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b225dd3-d6cb-4127-b60c-55fdf555fef3+7:2351:x1874206962851328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 41us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383338.383785:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1787383338.410224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383338.410587:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851712 00000100:00100000:2.0:1787383338.410605:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851712 00000100:00100000:2.0:1787383338.410720:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:2.0:1787383338.410757:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+6:2347:x1874206962851712:12345-192.168.202.19@tcp:39:umount.0 00000100:00080000:3.0:1787383338.410974:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787383338.411127:0:8068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ceb4a 00000020:00010000:2.0:1787383338.411139:0:8068:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ffc3cb27800: total 0 00000100:00080000:2.0:1787383338.411146:0:8068:0:(import.c:65:import_set_state_nolock()) ffff9ffc3cb21800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383338.411231:0:8068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787383338.411582:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f7d4d88-92fa-41ed-9228-fa6a1116f23d+5:2347:x1874206962851712:12345-192.168.202.19@tcp:39:umount.0 Request processed in 826us (1373us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787383338.411592:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 241 00000020:00010000:3.0:1787383338.413340:0:11031:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ffc3cb27800: total 0 00010000:00010000:3.0:1787383338.413354:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383338.414486:0:11031:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ffc3cb27800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787383338.414569:0:11031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc035c5a00) 00010000:00010000:2.0:1787383338.414573:0:11031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383338.414592:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046600/0x42020b050d5cfa77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4b3 expref: 4 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383338.414633:0:11031:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ffc3cb27800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787383338.414654:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383338.414656:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383338.414659:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383338.452132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383338.452905:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962851968 00000100:00100000:1.0:1787383338.452921:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962851968 00000100:00100000:1.0:1787383338.454258:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 304 00000100:00100000:1.0:1787383338.454291:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+7:2347:x1874206962851968:12345-192.168.202.19@tcp:251:umount.0 00000020:00000080:1.0:1787383338.454382:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea40 00000020:00010000:1.0:1787383338.454392:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ffc34f92800: total 0 00000100:00080000:1.0:1787383338.454397:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9ffc34f95800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787383338.454521:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b225dd3-d6cb-4127-b60c-55fdf555fef3+3:2347:x1874206962851968:12345-192.168.202.19@tcp:251:umount.0 Request processed in 249us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383338.454530:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 304 00000020:00010000:0.0:1787383338.455933:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ffc34f92800: total 0 00010000:00010000:0.0:1787383338.456019:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ffc34f92800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787383338.456071:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98000/0x42020b050d5ceaf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b045 expref: 2 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383338.456095:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ffc34f92800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787383338.456124:0:5792:0:(genops.c:906:class_export_put()) final put ffff9ffc34f92800/3b225dd3-d6cb-4127-b60c-55fdf555fef3 00010000:00010000:0.0:1787383338.456321:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383338.456324:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383338.456326:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787383338.456395:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc34f92800/3b225dd3-d6cb-4127-b60c-55fdf555fef3 for MGS 00000020:00000080:2.0:1787383338.456468:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc34f95800 for MGS 00000100:00100000:0.0:1787383338.762375:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979607040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383338.762478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383338.762728:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607040 00000100:00100000:3.0:1787383338.762739:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607040 00000100:00100000:3.0:1787383338.762812:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787383338.762825:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979607040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383338.762904:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383338.762959:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979607040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383338.762967:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787383338.763470:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979607040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383338.827134:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383339.274248:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383339.274290:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979607168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383339.274399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383339.276512:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607168 00000100:00100000:3.0:1787383339.276533:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607168 00000100:00100000:3.0:1787383339.276614:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383339.276627:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979607168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383339.276682:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1787383339.276787:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979607168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383339.276796:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383339.276911:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979607168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787383339.850014:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787383340.415717:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:3.0:1787383340.415733:0:7504:0:(genops.c:906:class_export_put()) final put ffff9ffc3dc72000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:2.0:1787383340.418771:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3dc72000/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-OST0001 00000020:00000080:2.0:1787383340.419020:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3dc77000 for lustre-OST0001 00000020:01000004:3.0:1787383340.766745:0:12825:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787383340.792140:0:12825:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787383340.792214:0:12825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792236:0:12825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792245:0:12825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792253:0:12825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792293:0:12825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787383340.792301:0:12825:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787383340.792339:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383340.792347:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792356:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047200 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383340.792359:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792370:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383340.792401:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383340.792408:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383340.792410:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787383340.792413:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787383340.792468:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792475:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383340.792508:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792516:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047200/0x42020b050d5ceac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceacc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792529:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383340.792531:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383340.792533:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383340.792558:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979607296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383340.792656:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383340.792762:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607296 00000100:00100000:3.0:1787383340.792771:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607296 00000100:00100000:3.0:1787383340.792848:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383340.792859:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc274fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3314:x1874206979607296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383340.792910:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383340.792932:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01410600/0x42020b050d5ceacc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ceac5 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.792961:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383340.793001:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc274fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3314:x1874206979607296:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383340.793009:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383340.793085:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979607296:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787383340.793119:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383340.793124:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787383340.793131:0:12825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383340.793149:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffc0357b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787383340.796977:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979607424:0@lo:39:umount.0 00000100:00100000:1.0:1787383340.797595:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383340.797713:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607424 00000100:00100000:3.0:1787383340.797726:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607424 00000100:00100000:3.0:1787383340.797799:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787383340.797810:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874206979607424:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787383340.797860:0:5805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce84f 00000100:00080000:3.0:1787383340.797902:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9ffc170f5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787383340.797982:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1874206979607424:12345-0@lo:39:umount.0 Request processed in 173us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383340.797992:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787383340.798005:0:5805:0:(genops.c:906:class_export_put()) final put ffff9ffc170f4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787383340.798181:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383340.798220:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc0357b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787383340.798241:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979607424:0@lo:39:umount.0 00000020:00000080:1.0:1787383340.798289:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc170f4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383340.798354:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc170f5000 for lustre-MDT0000 00000100:00080000:3.0:1787383340.798514:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383340.798518:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787383340.798524:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787383340.803495:0:12825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803522:0:12825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803552:0:12825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803560:0:12825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803648:0:12825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383340.803658:0:12825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803667:0:12825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803673:0:12825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.803680:0:12825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806016:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383340.806160:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806175:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98400 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:1.0:1787383340.806180:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806192:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383340.806200:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383340.806207:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383340.806231:0:11031:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787383340.806304:0:11031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806313:0:11031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383340.806412:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979607552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383340.806525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383340.806627:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806636:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98400/0x42020b050d5cead3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceada expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806660:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383340.806664:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806670:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047600 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:1.0:1787383340.806673:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806680:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383340.806686:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383340.806690:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383340.806693:0:11031:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1787383340.806708:0:11031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806714:0:11031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383340.806739:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.806748:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383340.806749:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383340.806751:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383340.807572:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979607680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383340.807632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.807865:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607552 00000100:00100000:1.0:1787383340.807899:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607552 00000100:00100000:1.0:1787383340.807962:0:8310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607680 00000100:00100000:1.0:1787383340.807965:0:8310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607680 00000100:00100000:1.0:1787383340.807993:0:8310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383340.808004:0:8310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3315:x1874206979607552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383340.808024:0:8310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787383340.808167:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383340.808180:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+19:3312:x1874206979607680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383340.808190:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383340.808208:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01411600/0x42020b050d5cea01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ce9fa expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.808230:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383340.808291:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+18:3312:x1874206979607680:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383340.808299:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787383340.808398:0:12825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787383340.808409:0:12825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047600/0x42020b050d5ce9fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cea01 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383340.808427:0:12825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787383340.808440:0:12825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808449:0:12825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808473:0:12825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808481:0:12825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808494:0:12825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383340.808499:0:12825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808505:0:12825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808511:0:12825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808518:0:12825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383340.808528:0:12825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787383340.808531:0:12825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787383340.808534:0:12825:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787383340.808566:0:12825:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787383340.808571:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787383340.808575:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383340.808582:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1787383340.808587:0:12825:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ffb0199d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383340.808593:0:12825:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ffc3ff81000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383340.808609:0:12825:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9ffc3cb27800 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383340.808614:0:12825:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9ffc2c0b0800 c5843774-e16e-46d1-9ea7-9bdf9153dca9 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 4294967524 stale:0 00000020:00080000:3.0:1787383340.808620:0:12825:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9ffc3d0219c0) has exports, disconnecting them 00000020:00080000:3.0:1787383340.808626:0:12825:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ffb0199d800), last request at 1787383338 00000020:00000080:3.0:1787383340.808634:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce9c2 00000100:00080000:3.0:1787383340.808652:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383340.808697:0:12825:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffb0199d800): rc 0 00000020:00000080:3.0:1787383340.808700:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffb0199d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787383340.808707:0:12825:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ffc3ff81000), last request at 1787383338 00000020:00000080:3.0:1787383340.808711:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce8e9 00000100:00080000:3.0:1787383340.808717:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffc3ff87000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383340.808723:0:12825:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc3ff81000): rc 0 00000020:00000080:3.0:1787383340.808725:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3ff81000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787383340.808735:0:12825:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc36403aa3ae0 00000100:00080000:3.0:1787383340.808763:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383340.808767:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787383340.808781:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787383340.808849:0:12825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787383340.808896:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffc2761e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787383340.808914:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383340.808917:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787383340.808925:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787383340.809015:0:12825:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787383340.809024:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc74000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787383340.809148:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383340.809156:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809165:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383340.809169:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809192:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383340.809200:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383340.809205:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787383340.809209:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787383340.809211:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787383340.809233:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809241:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383340.809256:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809274:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cecee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5cecf5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809286:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383340.809290:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809296:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411e00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383340.809299:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809305:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383340.809322:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383340.809328:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383340.809330:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787383340.809332:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787383340.809343:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.809348:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383340.809402:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515600/0x42020b050d5ceada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cead3 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.809415:0:8310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:3.0:1787383340.809500:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ffc3d0219c0) has no exports 00010000:00010000:0.0:1787383340.810336:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.810349:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411e00/0x42020b050d5ce7ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ce7b5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383340.810368:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383340.810370:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383340.810372:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383340.810556:0:8310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3315:x1874206979607552:12345-0@lo:103:ldlm_bl.0 Request processed in 2549us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383340.810568:0:8310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1787383340.810620:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb0199d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383340.810665:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3ff81000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383340.810693:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffb0199e800 for lustre-MDT0000 00000020:00000080:1.0:1787383340.810699:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3ff87000 for lustre-MDT0000 00010000:00010000:1.0:1787383340.810719:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383340.810739:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979607808:0@lo:9:umount.0 00000100:00100000:1.0:1787383340.810803:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.810995:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979607936:0@lo:9:umount.0 00000100:00100000:1.0:1787383340.811021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.811155:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979608064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383340.811185:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.811223:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383340.811242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.811300:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3312:1874206979607680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383340.811329:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979608064 00000100:00100000:1.0:1787383340.811336:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979608064 00000100:00100000:1.0:1787383340.811380:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979608192 00000100:00100000:1.0:1787383340.811382:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979608192 00000100:00100000:1.0:1787383340.811398:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383340.811406:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+17:3313:x1874206979608064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383340.811420:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383340.811442:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cecf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cecee expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.811458:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383340.811485:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+16:3313:x1874206979608064:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383340.811492:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383340.811503:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383340.811508:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+15:3314:x1874206979608192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383340.811515:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383340.811523:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc00031a00/0x42020b050d5ce7b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ce7ae expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383340.811548:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383340.811569:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267+14:3314:x1874206979608192:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383340.811575:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383340.811598:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3313:1874206979608064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383340.811613:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383340.811625:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383340.811737:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607808 00000100:00100000:0.0:1787383340.811742:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607808 00000100:00100000:0.0:1787383340.811967:0:11924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979607936 00000100:00100000:0.0:1787383340.811971:0:11924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979607936 00000100:00100000:3.0:1787383340.812139:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383340.812151:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874206979607808:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787383340.812187:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce936 00000100:00080000:3.0:1787383340.812198:0:6599:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383340.812241:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787383340.812461:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3311:x1874206979607808:12345-0@lo:9:umount.0 Request processed in 314us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383340.812468:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1787383340.812490:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383340.812538:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383340.812543:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383340.812569:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc2761e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787383340.812616:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:2.0:1787383340.812674:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3315:1874206979607552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383340.812763:0:11924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787383340.812771:0:11924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874206979607936:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787383340.812785:0:11924:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea39 00000100:00080000:0.0:1787383340.812791:0:11924:0:(import.c:65:import_set_state_nolock()) ffff9ffc3fcb2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383340.812815:0:11924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787383340.813242:0:11924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3311:x1874206979607936:12345-0@lo:9:umount.0 Request processed in 471us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383340.813258:0:11924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787383340.813429:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787383340.813491:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383340.813497:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979607808:0@lo:9:umount.0 00000100:00080000:1.0:1787383340.813516:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc74000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787383340.813534:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787383340.813536:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383340.813538:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979607936:0@lo:9:umount.0 00000020:00080000:1.0:1787383340.824139:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ffc3d0219c0) has no exports 00010000:00010000:3.0:1787383340.874050:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787383340.917483:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce809 00000020:00000080:1.0:1787383340.917512:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc349c1000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787383340.918002:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787383340.919499:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383340.919521:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787383340.919528:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9ffc173e8000) has no exports 00000020:00000080:3.0:1787383340.920114:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce802 00000020:00000080:3.0:1787383340.920128:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3dc15800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383340.920778:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc349c1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787383340.925975:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3dc15800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787383340.926449:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383340.926467:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787383340.926474:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3dc14000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787383340.926478:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3dc14000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787383340.926493:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1787383341.408334:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000001:00080000:1.0:1787383341.408360:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787383341.408368:0:5826:0:(genops.c:906:class_export_put()) final put ffff9ffc3cb27800/7f7d4d88-92fa-41ed-9228-fa6a1116f23d 00000001:00100000:1.0:1787383341.408390:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000001:00080000:1.0:1787383341.408396:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787383341.408409:0:5826:0:(genops.c:906:class_export_put()) final put ffff9ffc2c0b0800/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:1.0:1787383341.408432:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3cb27800/7f7d4d88-92fa-41ed-9228-fa6a1116f23d for lustre-MDT0000 00000020:00000080:1.0:1787383341.408493:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2c0b0800/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-MDT0000 00000020:00000080:1.0:1787383341.408534:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3cb21800 for lustre-MDT0000 00000020:00000080:1.0:1787383341.408539:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3fcb5800 for lustre-MDT0000 00000001:00100000:1.0:1787383341.430274:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787383341.430291:0:6624:0:(genops.c:906:class_export_put()) final put ffff9ffc3fcb6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787383341.430329:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:1.0:1787383341.430332:0:6624:0:(genops.c:906:class_export_put()) final put ffff9ffc3e58c800/c5843774-e16e-46d1-9ea7-9bdf9153dca9 00000020:00000080:2.0:1787383341.430447:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3fcb6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787383341.430527:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3e58c800/c5843774-e16e-46d1-9ea7-9bdf9153dca9 for lustre-OST0000 00000020:00000080:2.0:1787383341.430556:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3fcb7800 for lustre-OST0000 00000020:00000080:2.0:1787383341.430561:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3e58b000 for lustre-OST0000 00010000:00010000:3.0:1787383341.900007:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383342.923011:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787383342.986512:0:12825:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc2fda00c0 - data ffff9ffc2ff01e58/ffff9ffc2fd99000 00000020:01000000:3.0:1787383342.986736:0:12825:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc05f56480 - data ffff9ffc26c2e000/ffff9ffc2cf38000 00000001:00000004:3.0:1787383342.996396:0:12825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787383343.106375:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383343.106386:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787383343.106415:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383343.106419:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787383343.106972:0:6792:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787383343.106978:0:6792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787383343.106988:0:6792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787383343.107999:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383343.108005:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787383343.108023:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383343.108025:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787383343.108373:0:7866:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787383343.108377:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787383343.108385:0:7866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787383343.195061:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce7d1 00000020:00000080:1.0:1787383343.195074:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3d02c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787383343.196455:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce7e6 00000020:00000080:1.0:1787383343.196465:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3d02a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383343.199054:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d02c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787383343.200275:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787383343.200288:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.200299:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787383343.200305:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9ffc3d020000) has no exports 00000004:01000000:1.0:1787383343.200505:0:12825:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787383343.200515:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea24 00000020:00000080:1.0:1787383343.200524:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc34f97800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383343.201023:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d02a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787383343.206297:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787383343.206317:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.206333:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787383343.206338:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9ffc3cf7b380) has no exports 00000020:00000080:1.0:1787383343.206350:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5cea1d 00000020:00000080:1.0:1787383343.206359:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3dc72800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383343.206766:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc34f97800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787383343.206778:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3dc72800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787383343.207060:0:12825:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787383343.207065:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787383343.207070:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787383343.207076:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383343.207091:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383343.207170:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.207180:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383343.207190:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce92f 00000020:00000080:1.0:1787383343.207197:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc2761c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383343.207216:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3dc74000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787383343.207222:0:37:0:(genops.c:906:class_export_put()) final put ffff9ffc05ffa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383343.207224:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc05ffa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787383343.207229:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787383343.209387:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787383343.209403:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.209415:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787383343.209420:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9ffc0cf30000) has no exports 00000020:00000080:1.0:1787383343.209430:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce928 00000020:00000080:1.0:1787383343.209438:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc2761d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383343.209462:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2761c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787383343.213389:0:12825:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787383343.213399:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787383343.213403:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787383343.213412:0:12825:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383343.213414:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383343.216584:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2761d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787383343.217688:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.217710:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383343.217749:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.217753:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383343.217759:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc2ca26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787383343.217764:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2ca26800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787383343.217777:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383343.218055:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce7ed 00000020:00000080:1.0:1787383343.218063:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3d028000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787383343.220135:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc2761e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787383343.220152:0:37:0:(genops.c:906:class_export_put()) final put ffff9ffc3ff81800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383343.220155:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3ff81800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787383343.220163:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787383343.222153:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787383343.222193:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.222205:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787383343.222210:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9ffc3d023380) has no exports 00000020:00000080:1.0:1787383343.222259:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.222267:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787383343.222278:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce7f4 00000020:00000080:1.0:1787383343.222303:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3d02a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383343.225125:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d028000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787383343.225143:0:37:0:(genops.c:906:class_export_put()) final put ffff9ffc3d02e800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787383343.225146:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d02e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787383343.225163:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1787383343.227146:0:12825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc2750b800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787383343.227157:0:12825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc2750b800 3 00000020:01000004:1.0:1787383343.227160:0:12825:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffc2750b800 from lustre-MDT0000 00000020:00000080:1.0:1787383343.227191:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.227202:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787383343.227207:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc3d02d000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787383343.227211:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d02d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787383343.227230:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787383343.227300:0:12825:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787383343.227305:0:12825:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787383343.227309:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787383343.227314:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.227319:0:12825:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787383343.227326:0:12825:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9ffc0cc8b800 f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383343.227333:0:12825:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9ffc173eb380) has exports, disconnecting them 00000020:00080000:1.0:1787383343.227339:0:12825:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ffc0cc8b800), last request at 1787383120 00000020:00000080:1.0:1787383343.227354:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce792 00000020:00010000:1.0:1787383343.227361:0:12825:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ffc0cc8b800: total 1 00000100:00080000:1.0:1787383343.227365:0:12825:0:(import.c:65:import_set_state_nolock()) ffff9ffc0cc8e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787383343.227377:0:12825:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc0cc8b800): rc 0 00000020:00080000:1.0:1787383343.227382:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9ffc173eb380) has no exports 00000100:00100000:1.0:1787383343.227439:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ffc08eb3200:5798] 2 exiting: rc = 0 00000100:00100000:1.0:1787383343.227548:0:5796:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ffc08eb2600:5796] 0 exiting: rc = 1 00000100:00100000:1.0:1787383343.227604:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ffc10f7d400:5797] 1 exiting: rc = 0 00000100:00100000:1.0:1787383343.227662:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227670:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227676:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227682:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227689:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227694:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227701:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227721:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227728:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227736:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227742:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227747:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227753:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227759:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227765:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227770:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227776:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227782:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227787:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227792:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227797:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227802:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227823:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227829:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227834:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227839:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227845:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227851:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227856:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227862:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227894:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227900:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227906:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227911:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227916:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227922:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227926:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227936:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227941:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227947:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227953:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227958:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227972:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227978:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227984:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227989:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227994:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.227999:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228005:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228010:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228015:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228020:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228025:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228031:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228036:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228041:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228046:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228052:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228057:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228063:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228069:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228075:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228081:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.228086:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787383343.228515:0:12825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787383343.228519:0:12825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:3.0:1787383343.230417:0:11031:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ffc0cc8b800: total 1 00010000:00010000:3.0:1787383343.230484:0:11031:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ffc0cc8b800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787383343.230525:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99800/0x42020b050d5ceaa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cea9b expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230561:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515800/0x42020b050d5cea94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cea8d expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230574:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01411000/0x42020b050d5ceab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ceaa9 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230585:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01515200/0x42020b050d5ceabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ceab7 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230596:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046000/0x42020b050d5cece7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cece0 expref: 5 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230605:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc01662800/0x42020b050d5ce89c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ce895 expref: 4 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230618:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047a00/0x42020b050d5cecd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5cecd2 expref: 3 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230630:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc00030a00/0x42020b050d5ceae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42020b050d5ceae1 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.230642:0:11031:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ffc0cc8b800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787383343.230656:0:11031:0:(genops.c:906:class_export_put()) final put ffff9ffc0cc8b800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 00000020:00000080:0.0:1787383343.232673:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3d02a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787383343.237281:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383343.237289:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383343.237292:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787383343.238010:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc0cc8b800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 for MGS 00000020:00000080:0.0:1787383343.245289:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc0cc8e000 for MGS 00000020:01000000:3.0:1787383343.245399:0:12825:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc3c8d8f00 - data ffff9ffc26e8f288/ffff9ffc351a2c00 00000020:01000000:3.0:1787383343.245686:0:12825:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc04f45780 - data ffff9ffc38370e58/ffff9ffc173f9800 00000020:00000080:3.0:1787383343.246369:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce776 00000020:00000080:3.0:1787383343.246391:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc05ec9000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787383343.246449:0:12825:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc2750b800 from MGS, refs=2 00000020:01000004:3.0:1787383343.246453:0:12825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc2750b800 2 00000020:01000004:3.0:1787383343.246456:0:12825:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffc2750b800 from MGS 00000020:00000080:3.0:1787383343.246494:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383343.246502:0:12825:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787383343.246505:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc05eca800/MGS 00000020:00000080:3.0:1787383343.246508:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc05eca800/MGS for MGS 00000020:01000000:3.0:1787383343.246515:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787383343.246574:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787383343.246579:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383343.246585:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383343.246592:0:12825:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ffc21525000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383343.246598:0:12825:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9ffc0cf33380) has exports, disconnecting them 00000020:00080000:3.0:1787383343.246603:0:12825:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ffc21525000), last request at 1787383121 00000020:00000080:3.0:1787383343.246609:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce841 00000020:00080000:3.0:1787383343.246618:0:12825:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc21525000): rc 0 00000020:00000080:3.0:1787383343.246623:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc21525000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787383343.249730:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc05ec9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787383343.259151:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc21525000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787383343.286029:0:12825:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787383343.286042:0:12825:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787383343.286049:0:12825:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787383343.286060:0:12825:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383343.286107:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc0357b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787383343.293018:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.293045:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787383343.293054:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc21520000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787383343.293088:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc21520000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787383343.293102:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787383343.293199:0:12825:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc2750b800 1 00000020:00000080:1.0:1787383343.294081:0:12825:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce768 00000020:00000080:1.0:1787383343.294097:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc05ec8000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787383343.294121:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787383343.294129:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.294137:0:12825:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787383343.294143:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9ffc173e99c0) has no exports 00000020:00000080:0.0:1787383343.294255:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc05ec8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787383343.352261:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383343.352278:0:12825:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787383343.352285:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc27508800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787383343.352290:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc27508800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787383343.352297:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787383343.352434:0:12825:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffc27509800 00000020:01000000:1.0:1787383343.352484:0:12825:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787383343.352490:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383343.352496:0:12825:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787383343.352501:0:12825:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9ffc0cf319c0) has no exports 00000100:00100000:2.0:1787383343.355007:0:8068:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ffc170cda00:8068] 3 exiting: rc = 0 00000100:00100000:2.0:1787383343.355146:0:5803:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ffc1718fe00:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1787383343.355262:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ffc1718fa00:5804] 1 exiting: rc = 0 00000100:00100000:3.0:1787383343.363151:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ffc1718ea00:5805] 2 exiting: rc = 0 00000100:00100000:0.0:1787383343.364028:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364037:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364043:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364049:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364055:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364062:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364069:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364074:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364080:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364087:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364092:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364099:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364105:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364110:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364116:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364122:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364128:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364135:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364141:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364147:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364153:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364159:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364165:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364170:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364176:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364183:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364188:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364214:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364219:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364224:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364230:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364235:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364251:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364258:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364263:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364269:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364274:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364279:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364284:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364289:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364295:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364299:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364304:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364308:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364313:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364318:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364323:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364328:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364333:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364340:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364346:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364352:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364358:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364364:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364370:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364377:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364381:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364387:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364392:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364398:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364403:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364409:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364422:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.364427:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.376647:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ffc1718de00:5807] 1 exiting: rc = 0 00000100:00100000:3.0:1787383343.378839:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ffc1718d200:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1787383343.380442:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383343.380476:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608320:0@lo:400:kworker.0 00000400:00000100:0.0:1787383343.380544:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206979608320 offset 0 length 224: 4 00000100:00100000:0.0:1787383343.380600:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979608448:0@lo:400:kworker.0 00000400:00000100:0.0:1787383343.380620:0:3312:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979608448 offset 0 length 224: 4 00000100:00100000:0.0:1787383343.380634:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383343.380639:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979608576:0@lo:400:kworker.0 00000400:00000100:0.0:1787383343.380653:0:3312:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979608576 offset 0 length 224: 4 00000100:00100000:0.0:1787383343.380759:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380769:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380778:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380784:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380790:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380796:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380803:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380822:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380828:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380835:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380841:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380850:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380858:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380864:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380888:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380894:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380899:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380904:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380910:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380915:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380920:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380939:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380945:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380951:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380957:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380962:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380973:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380978:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380983:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380988:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380994:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.380999:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381003:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381008:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381013:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381018:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381023:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381027:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381032:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381036:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381041:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381045:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381050:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381054:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381059:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381064:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381068:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381074:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381078:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381083:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381089:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381094:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381099:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381103:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381109:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381114:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381126:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381130:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381135:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381140:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381145:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381151:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381156:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381161:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.381623:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ffc0cf59600:5809] 1 exiting: rc = 0 00000100:00100000:2.0:1787383343.384744:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ffc0cf59400:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1787383343.384860:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384900:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384916:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384923:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384930:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384935:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384941:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384958:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384965:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384970:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384975:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384983:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384989:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.384994:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385000:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385007:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385014:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385020:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385026:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385044:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385051:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385056:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385063:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385068:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385073:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385079:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385106:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385114:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385119:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385125:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385131:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385154:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385161:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385168:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385174:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385180:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385185:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385190:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385196:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385202:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385208:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385213:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385219:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385248:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385256:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385262:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385268:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385275:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385280:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385287:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385292:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385298:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385303:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385310:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385316:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385333:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385342:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385348:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385354:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385360:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385366:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385378:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385384:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.385398:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383343.410051:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ffc0cf59a00:5811] 1 exiting: rc = 0 00000100:00100000:3.0:1787383343.410228:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ffc0cf59e00:5810] 0 exiting: rc = 1 00000100:00100000:1.0:1787383343.410280:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410288:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410293:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410299:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410303:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410308:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410312:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410317:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410322:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410327:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410333:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410345:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410351:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410382:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410410:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410417:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410422:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410427:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410432:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410437:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410443:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410449:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410454:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410460:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410465:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410470:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410561:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410570:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410576:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410581:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410585:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410590:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410595:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410600:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410605:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410610:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410616:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410621:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410626:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410631:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410636:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410641:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410646:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410651:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410656:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410662:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410674:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410680:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410691:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410712:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410736:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410742:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410746:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410751:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410756:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410761:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410765:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410770:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410775:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410779:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410784:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410789:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410794:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.410799:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383343.411330:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ffc0cf59c00:5813] 1 exiting: rc = 0 00000100:00100000:0.0:1787383343.411330:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ffc0cf58800:5812] 0 exiting: rc = 1 00000100:00100000:1.0:1787383343.411390:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411397:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411402:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411407:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411413:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411417:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411422:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411427:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411432:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411437:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411443:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411449:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411455:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411460:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411466:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411471:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411488:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411493:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411498:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411511:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411516:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411520:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411525:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411530:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411535:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411539:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411545:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411549:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411555:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411559:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411564:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411568:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411573:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411578:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411582:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411587:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411592:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411596:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411600:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411604:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411608:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411613:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411618:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411622:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411626:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411632:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411643:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411648:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411653:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411658:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411663:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411667:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411672:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411681:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411692:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411696:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411701:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411705:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411710:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411717:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411722:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411727:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411731:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.411736:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383343.412522:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ffc1718f600:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1787383343.412724:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ffc10ee4200:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1787383343.412805:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412895:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412901:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412906:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412911:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412917:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412922:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412927:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412932:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412937:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412942:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412947:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.412953:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413021:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413027:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413031:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413036:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413041:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413045:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413050:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413054:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413059:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413063:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413068:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413072:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413086:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413091:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413095:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413100:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413105:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413110:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413115:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413120:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413341:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413349:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413354:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413358:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413363:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413367:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413372:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413376:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413380:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413384:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413388:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413393:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413397:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413402:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413407:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413412:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413417:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413421:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413425:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413429:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413433:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413438:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413443:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413448:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413453:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413458:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413463:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413475:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413577:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413589:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.413595:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383343.416317:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ffc05ec5800:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1787383343.416317:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ffc2ca28800:5818] 2 exiting: rc = 0 00000100:00100000:2.0:1787383343.416554:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ffc05ec5000:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1787383343.416605:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416612:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416617:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416644:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416650:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416655:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416660:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416665:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416672:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416677:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416682:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416687:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416692:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416697:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416702:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416707:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416712:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416716:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416721:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416727:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416732:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416736:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416741:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416746:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416751:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416756:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416761:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416777:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416784:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416795:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416940:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416946:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416951:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416956:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416961:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416966:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416971:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416977:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416981:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416987:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416991:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.416996:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417001:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417007:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417012:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417017:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417022:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417027:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417032:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417037:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417042:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417060:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417065:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417070:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417074:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417079:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417084:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417090:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417094:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417099:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417105:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417110:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417116:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383343.417121:0:12825:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787383343.428777:0:12825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383343.428793:0:12825:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787383343.428799:0:12825:0:(genops.c:906:class_export_put()) final put ffff9ffc21526800/MDS_uuid 00000020:00000080:0.0:1787383343.428805:0:12825:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc21526800/MDS_uuid for MDS 00000020:01000000:0.0:1787383343.428998:0:12825:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787383343.429148:0:12825:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787383343.948118:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383344.970281:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787383345.505634:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787383345.505649:0:7504:0:(genops.c:906:class_export_put()) final put ffff9ffc3fcb0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787383345.505754:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3fcb0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787383345.505837:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3fcb2000 for lustre-OST0001 00010000:00010000:0.0:1787383345.998714:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383346.506580:0:12981:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787383346.517725:0:12981:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787383346.517774:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.517800:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.517808:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.517815:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.517839:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787383346.517845:0:12981:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787383346.517904:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383346.517918:0:12981:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffb029ad500 x1874206979608448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383346.517937:0:12981:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787383346.517944:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787383346.517970:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9ffc3ff80000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787383346.518104:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979608448:0@lo:400:kworker.0 00000100:00100000:1.0:1787383346.518137:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979608704:0@lo:39:umount.0 00000400:00000100:1.0:1787383346.518191:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979608704 offset 0 length 224: 4 00010000:00010000:0.0:1787383346.518341:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383346.518348:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518356:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383346.518360:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518370:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383346.518378:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383346.518383:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383346.518431:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787383346.518434:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787383346.518462:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518478:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383346.518505:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518512:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98800/0x42020b050d5ceaa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42020b050d5ceab0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518521:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383346.518523:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383346.518525:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383346.518581:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383346.518698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383346.518780:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979608832 00000100:00100000:1.0:1787383346.518787:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979608832 00000100:00100000:1.0:1787383346.518955:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383346.518964:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874206979608832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787383346.518970:0:5788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383346 with bad export cookie 4756376272783599506 00000100:00100000:2.0:1787383346.533232:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1874206979608832:12345-0@lo:103:ldlm_bl.0 Request processed in 14260us (14525us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787383346.533247:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787383346.533361:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787383346.533368:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9ffc05ecd000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787383346.533373:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787383346.543472:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.119@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787383346.543479:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787383346.543491:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffb029af100 x1874206979608320/t0(0) o400->MGC192.168.202.119@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787383359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383346.543505:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffb029ac000 x1874206979608832/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383362 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787383346.543513:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787383346.543516:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787383346.543518:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787383346.543521:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9ffc05ecd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383346.543526:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 144 00000100:00080000:0.0:1787383346.543535:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffff9ffc05ecd000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1787383346.544410:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc37fb5c00 x1874206979608960/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383346.544467:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979608960:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787383346.544523:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206979608960 offset 0 length 520: 4 00000100:00100000:2.0:1787383346.544592:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.544615:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3314:1874206979608832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383347.018144:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383348.043223:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383348.490310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383348.490321:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383348.490407:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979609088:0@lo:400:kworker.0 00000400:00000100:1.0:1787383348.490466:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979609088 offset 0 length 224: 4 00010000:00010000:0.0:1787383349.067149:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.090950:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383351.118486:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383351.498069:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383351.498085:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787383351.498455:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979609216:0@lo:400:kworker.0 00000400:00000100:0.0:1787383351.498546:0:3312:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979609216 offset 0 length 224: 4 00010000:00010000:0.0:1787383352.139426:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383353.165324:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383354.186202:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383355.211426:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383356.234646:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383356.682428:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383346/real 1787383346] req@ffff9ffc37fb5c00 x1874206979608960/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383356.682467:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1787383356.682473:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffc37fb5c00 x1874206979608960/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383356 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383356.682476:0:12132:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383356.682490:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383346/real 1787383346] req@ffff9ffc37fb7100 x1874206979608704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383356.682531:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffc37fb7100 x1874206979608704/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383356 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383356.682553:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc05ecd000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383356.682569:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787383356.682574:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979608960:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1787383356.682580:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3ff80000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787383356.682593:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979608704:0@lo:39:umount.0 00000100:00080000:2.0:1787383356.682641:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383356.682646:0:12132:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787383356.682650:0:12132:0:(import.c:65:import_set_state_nolock()) ffff9ffc05ecd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383356.682656:0:12132:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 370 00000100:00100000:1.0:1787383356.682661:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1787383356.682663:0:12132:0:(import.c:589:import_select_connection()) MGC192.168.202.119@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383356.682673:0:12132:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffff9ffc05ecd000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1787383356.682678:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979609344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.682696:0:12132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc37fb6680 x1874206979609472/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383356.682737:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383356.682743:0:12981:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000400:00000100:1.0:1787383356.682744:0:3312:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979609344 offset 0 length 224: 4 00000100:00100000:2.0:1787383356.682750:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787383356.682812:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979609472:0@lo:250:kworker.0 00000400:00000100:1.0:1787383356.682831:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206979609472 offset 0 length 520: 4 00010000:00010000:2.0:1787383356.686818:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686846:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686855:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686861:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686920:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383356.686930:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686938:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686946:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686953:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383356.686978:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787383356.687003:0:12981:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787383356.687035:0:12981:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787383356.687042:0:12981:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787383356.687049:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383356.687056:0:12981:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787383356.687062:0:12981:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ffc17098000) has no exports 00000020:00080000:2.0:1787383356.687097:0:12981:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ffc17098000) has no exports 00010000:00010000:3.0:1787383356.688707:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383356.688743:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688755:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383356.688761:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688772:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383356.688781:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383356.688786:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383356.688789:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787383356.688792:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787383356.688816:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:3.0:1787383356.688820:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688827:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5ceab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ceabe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688849:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383356.688853:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688858:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383356.688861:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688951:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383356.688958:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383356.688964:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787383356.688966:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787383356.688968:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787383356.688974:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:3.0:1787383356.688977:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688983:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98c00/0x42020b050d5cece0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cece7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383356.688993:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383356.688995:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383356.688997:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383356.689317:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787383356.696151:0:12981:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc3fc2e060 - data ffff9ffc2ff11360/ffff9ffc37f87000 00000020:01000000:2.0:1787383356.696309:0:12981:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc351ffea0 - data ffff9ffb014716c0/ffff9ffc3fc7c000 00100000:10000000:2.0:1787383356.722125:0:12981:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787383356.766835:0:12981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce8b8 00000020:00000080:1.0:1787383356.766849:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc3c82a800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787383356.766898:0:12981:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc3dc13000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787383356.766904:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3dc13000 2 00000020:01000004:1.0:1787383356.766908:0:12981:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffc3dc13000 from lustre-OST0000 00000020:00000080:1.0:1787383356.766945:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383356.766959:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787383356.766962:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc3c829800/lustre-OST0000_UUID 00000020:00000080:1.0:1787383356.766965:0:12981:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3c829800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787383356.766975:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787383356.767040:0:12981:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787383356.767045:0:12981:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787383356.767049:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383356.767071:0:12981:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787383356.767079:0:12981:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ffc3ff80800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383356.767086:0:12981:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9ffc0cf34d40) has exports, disconnecting them 00000020:00080000:1.0:1787383356.767092:0:12981:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ffc3ff80800), last request at 1787383136 00000020:00000080:1.0:1787383356.767096:0:12981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce8e2 00000020:00080000:1.0:1787383356.767106:0:12981:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc3ff80800): rc 0 00000020:00000080:1.0:1787383356.767125:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc3ff80800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787383356.767478:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3c82a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787383356.767495:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3ff80800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787383356.769108:0:12981:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787383356.769130:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383356.769135:0:12981:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383356.769146:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383356.769180:0:12132:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc3ff80000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787383356.769360:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383356.769371:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787383356.769376:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc27618800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787383356.769381:0:12981:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc27618800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787383356.769390:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787383356.769460:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3dc13000 1 00000020:00000080:2.0:1787383356.769469:0:12981:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce872 00000020:00000080:2.0:1787383356.769477:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc2c0b4800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787383356.769486:0:12981:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787383356.769495:0:12132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2c0b4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787383356.769505:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383356.769510:0:12981:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787383356.769515:0:12981:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9ffc1709cd40) has no exports 00000020:00000080:2.0:1787383356.799303:0:12981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383356.799327:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787383356.799335:0:12981:0:(genops.c:906:class_export_put()) final put ffff9ffc3dc10000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787383356.799341:0:12981:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3dc10000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787383356.799350:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787383356.799524:0:12981:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffc3dc15000 00000020:02000400:2.0:1787383356.799602:0:12981:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787383357.261628:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383358.287419:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383359.309206:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787383359.756446:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383343/real 1787383343] req@ffff9ffb029af480 x1874206979608576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383359.788181:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ffb029af480 x1874206979608576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383359.788200:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787383359.788204:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787383359.802118:0:3312:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1787383359.802242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383359.802250:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383359.802253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383359.802257:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383359.802261:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383359.802272:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 176 00000100:00080000:0.0:1787383359.802285:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ffb0199c800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383359.802340:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffb029ac700 x1874206979609600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383359.802408:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979608576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383359.810306:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979609600:0@lo:38:kworker.0 00000400:00000100:1.0:1787383359.810389:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206979609600 offset 0 length 520: 4 00000020:01000004:1.0:1787383359.931068:0:13132:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787383359.945423:0:13132:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787383359.945532:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.945551:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.945558:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.945588:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.945829:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787383359.945837:0:13132:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787383359.945944:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787383359.945959:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc3ce1df80 x1874206979609088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383359.945991:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc3ce1d500 x1874206979609216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383359.946015:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc37fb5180 x1874206979609344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383359.946023:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffb029ac700 x1874206979609600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383359.946026:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979609088:0@lo:400:kworker.0 00000100:00100000:1.0:1787383359.946036:0:13132:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1787383359.946358:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383359.946367:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383359.946375:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:2.0:1787383359.946379:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383359.946388:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383359.946395:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383359.946401:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383359.946404:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787383359.946406:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787383359.946422:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:2.0:1787383359.946426:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383359.946432:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411800/0x42020b050d5cea8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cea94 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383359.946452:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383359.946454:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383359.946456:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383359.950757:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383359.950777:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1787383359.950785:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979609600:0@lo:38:kworker.0 00000100:00080000:1.0:1787383359.950831:0:13132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787383359.950839:0:13132:0:(import.c:65:import_set_state_nolock()) ffff9ffb0199c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1787383359.951027:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979609344:0@lo:400:kworker.0 00000100:00100000:0.0:1787383359.951039:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979609216:0@lo:400:kworker.0 00000100:00080000:1.0:1787383359.951220:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787383359.951288:0:13132:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787383359.951295:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787383359.952730:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952774:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952782:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952788:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952817:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383359.952826:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952833:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952840:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952856:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383359.952908:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787383359.952913:0:13132:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1787383359.953006:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383359.953015:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953023:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01411c00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383359.953035:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953045:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383359.953054:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383359.953060:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383359.953063:0:11031:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787383359.953065:0:11031:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787383359.953082:0:11031:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:0.0:1787383359.953096:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953104:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411c00/0x42020b050d5cea9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ceaa2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953120:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383359.953124:0:11031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953130:0:11031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99200 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383359.953133:0:11031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953139:0:11031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383359.953145:0:11031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383359.953156:0:11031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787383359.953159:0:11031:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787383359.953161:0:11031:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787383359.953166:0:11031:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:0.0:1787383359.953169:0:11031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953175:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99200/0x42020b050d5cecd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5cecd9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383359.953189:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383359.953191:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383359.953193:0:11031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383359.953204:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383359.953338:0:13132:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787383359.953344:0:13132:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787383359.953350:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383359.953356:0:13132:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787383359.953363:0:13132:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ffc1709b380) has no exports 00000020:00080000:1.0:1787383359.953398:0:13132:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ffc1709b380) has no exports 00000020:01000000:1.0:1787383359.957469:0:13132:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffc3fc2e960 - data ffff9ffc2ff11af8/ffff9ffc37fdb400 00000020:01000000:1.0:1787383359.957660:0:13132:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ffb020c5cc0 - data ffff9ffc2fe006c0/ffff9ffb0129c400 00100000:10000000:1.0:1787383359.971475:0:13132:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787383359.996340:0:13132:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce991 00000020:00000080:3.0:1787383359.996354:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffb024ff000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787383359.996380:0:13132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc3ff86800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787383359.996384:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3ff86800 2 00000020:01000004:3.0:1787383359.996387:0:13132:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffc3ff86800 from lustre-OST0001 00000020:00000080:3.0:1787383359.996423:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383359.996436:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787383359.996439:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffc3c82b800/lustre-OST0001_UUID 00000020:00000080:3.0:1787383359.996442:0:13132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3c82b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787383359.996450:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787383359.996584:0:13132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f5c45d0c-8d4a-4848-86e1-7f0dbcd24267->MGS 00010000:00010000:3.0:1787383359.996625:0:13132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc01411400/0x42020b050d5ce895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383359.996638:0:13132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc01411400/0x42020b050d5ce895 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383359.996644:0:13132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787383359.996647:0:13132:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787383359.996651:0:13132:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787383359.996833:0:13132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:3.0:1787383359.996838:0:13132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc01411400/0x42020b050d5ce895 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ce89c expref: -99 pid: 6596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383359.996856:0:13132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383359.996862:0:13132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383359.996897:0:13132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383359.996899:0:13132:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787383359.996900:0:13132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787383359.996911:0:13132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffc05ecd000 00010000:00010000:3.0:1787383359.996914:0:13132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5ceae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42020b050d5ceae8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787383359.997040:0:13132:0:(import.c:65:import_set_state_nolock()) ffff9ffc05ecd000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787383359.997046:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787383359.997049:0:13132:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787383359.997051:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787383359.997056:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787383359.997073:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc37fb6680 x1874206979609472/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787383371 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787383359.997108:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787383359.997112:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1787383359.997199:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5c45d0c-8d4a-4848-86e1-7f0dbcd24267:3311:1874206979609472:0@lo:250:kworker.0 10000000:01000000:3.0:1787383359.997266:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383359.997275:0:13132:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce784 00000020:00000080:3.0:1787383359.997281:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffc21521800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 00000020:01000000:3.0:1787383359.997289:0:13132:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.119@tcp (flags='') 00000020:00000080:3.0:1787383359.997295:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383359.997300:0:13132:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787383359.997304:0:13132:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9ffc173ecd40) has no exports 10000000:01000000:2.0:1787383359.997429:0:5800:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787383359.997499:0:13132:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.119@tcp: client import never connected 00000100:00080000:3.0:1787383359.997502:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787383359.997504:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787383359.997506:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787383359.997507:0:13132:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383359.997543:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383359.997548:0:13132:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.119@tcp (uuid f5c45d0c-8d4a-4848-86e1-7f0dbcd24267) 00000020:01000000:3.0:1787383359.997553:0:13132:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787383359.997556:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383359.997559:0:13132:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383359.997564:0:13132:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ffb0199b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383359.997569:0:13132:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9ffc3d024d40) has exports, disconnecting them 00000020:00080000:3.0:1787383359.997573:0:13132:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ffb0199b000), last request at 1787383152 00000020:00000080:3.0:1787383359.997577:0:13132:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce9bb 00000020:00080000:3.0:1787383359.997588:0:13132:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffb0199b000): rc 0 00000020:00000080:3.0:1787383359.997600:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffb0199b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787383359.998569:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb024ff000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787383359.998584:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc21521800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 for MGC192.168.202.119@tcp 00000020:00000080:0.0:1787383359.998590:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffc05ecd000 for MGC192.168.202.119@tcp 00000020:00000080:0.0:1787383360.000533:0:36:0:(genops.c:906:class_export_put()) final put ffff9ffc173c3800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 00000020:00000080:0.0:1787383360.000544:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc173c3800/f5c45d0c-8d4a-4848-86e1-7f0dbcd24267 for MGC192.168.202.119@tcp 00000020:01000000:0.0:1787383360.000553:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.119@tcp (f5c45d0c-8d4a-4848-86e1-7f0dbcd24267) 00000020:00000080:0.0:1787383360.002406:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb0199b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787383360.002547:0:13132:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787383360.002553:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383360.002559:0:13132:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383360.002565:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787383360.002636:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787383360.003197:0:11031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1787383360.003273:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ffb0199c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787383360.003716:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787383360.004399:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ffc03f2fe00:5787] 1 exiting: rc = 0 00000100:00100000:2.0:1787383360.028123:0:5786:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ffc03f2f600:5786] 0 exiting: rc = 1 00000100:00100000:0.0:1787383360.028410:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383360.028835:0:8310:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ffc2fd59200:8310] 3 exiting: rc = 0 00000100:00100000:2.0:1787383360.028954:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ffc08eb3800:5790] 2 exiting: rc = 0 00000100:00100000:2.0:1787383360.029018:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ffc02c1de00:5788] 0 exiting: rc = 1 00000100:00100000:1.0:1787383360.030342:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ffc02c1d000:5789] 1 exiting: rc = 0 00000100:00100000:0.0:1787383360.031632:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031644:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031660:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031688:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031695:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031700:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031708:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031714:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031723:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031733:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031739:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031745:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031761:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031769:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031775:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031783:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031790:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031795:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031801:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031807:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031813:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031819:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031825:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031835:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031842:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031848:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031854:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031860:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031865:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031889:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031895:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031901:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031906:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031912:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031918:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.031923:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032280:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032286:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032300:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032306:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032312:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032317:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032329:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032334:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032339:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032344:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032349:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032357:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032369:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032374:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032379:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032387:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032392:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032397:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032402:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032407:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032412:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032416:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032421:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032426:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032430:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032436:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032441:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.032447:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787383360.034395:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383360.034411:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787383360.034418:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffb01998000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787383360.034423:0:13132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffb01998000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787383360.034434:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787383360.034485:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc3ff86800 1 00000020:00000080:0.0:1787383360.034491:0:13132:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42020b050d5ce960 00000020:00000080:0.0:1787383360.034497:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffc05ffa800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787383360.034528:0:13132:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787383360.034532:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383360.034538:0:13132:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787383360.034543:0:13132:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9ffc170999c0) has no exports 00000020:00000080:2.0:1787383360.034685:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc05ffa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787383360.057128:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383360.057152:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787383360.057160:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffc3ff85800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787383360.057166:0:13132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc3ff85800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787383360.057180:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787383360.057423:0:13132:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffc3ff87800 00000020:01000000:0.0:1787383360.057450:0:13132:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787383360.057455:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383360.057460:0:13132:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383360.057465:0:13132:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9ffc3dc7b380) has no exports 00000020:00000080:0.0:1787383360.057488:0:13132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383360.057494:0:13132:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787383360.057497:0:13132:0:(genops.c:906:class_export_put()) final put ffff9ffc2c0b3000/OSS_uuid 00000020:00000080:0.0:1787383360.057499:0:13132:0:(genops.c:865:class_export_destroy()) destroying export ffff9ffc2c0b3000/OSS_uuid for OSS 00000020:01000000:0.0:1787383360.057504:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787383360.057569:0:5799:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787383360.057592:0:11924:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ffc1706e200:11924] 3 exiting: rc = 0 00000100:00100000:2.0:1787383360.062043:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ffc0a185800:6600] 1 exiting: rc = 0 00000100:00100000:2.0:1787383360.064220:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ffc0a185000:6601] 2 exiting: rc = 0 00000100:00100000:3.0:1787383360.074628:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ffc10ee3c00:6599] 0 exiting: rc = 1 00000100:00100000:0.0:1787383360.075606:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075617:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075627:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075635:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075640:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075755:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075767:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075774:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075780:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075785:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075791:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075796:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075802:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075808:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075840:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075845:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075851:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.075857:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077765:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077777:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077788:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077794:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077802:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077808:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077813:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077819:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077825:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077831:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077836:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077841:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077847:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077852:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077857:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077890:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077896:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077901:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077906:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077911:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.077922:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078126:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078135:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078154:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078232:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078239:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078244:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078249:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078254:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078259:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078265:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078285:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078290:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078295:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078301:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078321:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078329:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078585:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078591:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078596:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078602:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078607:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078612:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078617:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078622:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383360.078636:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.084383:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ffc0a184e00:6602] 0 exiting: rc = 1 00000100:00100000:1.0:1787383360.084639:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ffc27499e00:6603] 1 exiting: rc = 0 00000100:00100000:3.0:1787383360.084982:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.084995:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085001:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085027:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085033:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085038:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085045:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085051:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085058:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085064:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085069:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085075:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085090:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085096:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085102:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085108:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085113:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085119:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085124:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085129:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085135:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085140:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085146:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085154:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085160:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085166:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085172:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085178:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085183:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085189:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085195:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085200:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085206:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085211:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085216:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085221:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085226:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085232:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085245:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085252:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085257:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085263:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085268:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085273:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085279:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085284:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085290:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085296:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085303:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085309:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085314:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085319:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085325:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085330:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085336:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085341:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085347:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085352:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085460:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085469:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085475:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085481:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085486:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.085492:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.087481:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ffc35040c00:6606] 2 exiting: rc = 0 00000100:00100000:1.0:1787383360.088130:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ffc35040800:6604] 0 exiting: rc = 1 00000100:00100000:1.0:1787383360.088304:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ffc35041c00:6605] 1 exiting: rc = 0 00000100:00100000:3.0:1787383360.088718:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088726:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088733:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088740:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088746:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088751:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088757:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088764:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088787:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088793:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088800:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088805:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088812:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088818:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088824:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088830:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088837:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088854:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088863:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088891:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088897:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088903:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088910:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.088917:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089125:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089134:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089140:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089146:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089153:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089160:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089166:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089173:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089180:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089187:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089193:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089201:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089208:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089215:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089222:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089229:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089238:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089244:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089251:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089266:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089273:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089279:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089286:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089292:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089315:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089323:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089332:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089340:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089348:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089354:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089428:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089437:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089445:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089452:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089465:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089472:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089478:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089485:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089491:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.089501:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.098277:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ffc35041800:6607] 0 exiting: rc = 1 00000100:00100000:0.0:1787383360.098507:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ffc35041000:6608] 1 exiting: rc = 0 00000100:00100000:3.0:1787383360.098782:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098791:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098798:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098804:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098810:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098816:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098821:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098827:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098833:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098839:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.098844:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099054:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099062:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099067:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099100:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099106:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099112:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099117:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099123:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099128:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099133:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099138:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099143:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099148:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099154:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099159:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099165:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099171:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099176:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099182:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099187:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099193:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099198:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099203:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099208:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099213:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099219:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099224:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099229:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099234:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099240:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099245:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099251:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099257:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099263:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099269:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099274:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099280:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099285:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099297:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099302:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099309:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099314:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099320:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099326:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099332:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099337:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099343:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099349:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099355:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099430:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099437:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099442:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383360.099448:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101227:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ffc35040600:6610] 1 exiting: rc = 0 00000100:00100000:0.0:1787383360.101406:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ffc35040000:6609] 0 exiting: rc = 1 00000100:00100000:1.0:1787383360.101514:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101523:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101529:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101535:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101543:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101556:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101564:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101571:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101578:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101584:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101605:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101613:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101619:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101624:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101631:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101637:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101782:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101809:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101816:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101823:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101830:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101836:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101858:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101900:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101907:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101914:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101919:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101982:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.101992:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102014:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102023:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102030:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102037:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102044:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102052:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102058:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102065:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102071:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102077:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102093:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102100:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102121:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102128:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102135:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102142:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102149:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102157:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102164:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102170:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102176:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102186:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102191:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102197:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102220:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102228:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102235:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102243:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102257:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102264:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102272:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102278:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102286:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102291:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383360.102297:0:13132:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787383360.115758:0:13132:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787383378.944356:0:13748:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787383387.580219:0:14162:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787383387.580222:0:14162:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787383387.580321:0:14162:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ffb037d9000 00000020:01000004:0.0:1787383387.580336:0:14162:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787383387.580342:0:14162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787383387.580354:0:14162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ffc3cf7b380) 00000020:00000080:0.0:1787383387.580364:0:14162:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787383387.594755:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787383387.598672:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787383387.599153:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 375: rc = 0 00100000:10000000:1.0:1787383387.599233:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 375: rc = 0 00100000:10000000:1.0:1787383387.599400:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 375: rc = 0 00100000:10000000:1.0:1787383387.599469:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 375: rc = 0 00100000:10000000:1.0:1787383387.599550:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 375: rc = 0 00100000:10000000:1.0:1787383387.599753:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787383387.599798:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 375: rc = 0 00100000:10000000:1.0:1787383387.600077:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 377: rc = 0 00100000:10000000:1.0:1787383387.601336:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 579: rc = 0 00100000:10000000:1.0:1787383387.601454:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 579: rc = 0 00100000:10000000:1.0:1787383387.602070:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.602444:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 587: rc = 0 00100000:10000000:1.0:1787383387.602689:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 587: rc = 0 00100000:10000000:1.0:1787383387.602997:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 587: rc = 0 00100000:10000000:1.0:1787383387.603228:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.603640:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.603824:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.604122:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.604456:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 587: rc = 0 00100000:10000000:1.0:1787383387.604717:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 587: rc = 0 00100000:10000000:1.0:1787383387.605212:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 587: rc = 0 00100000:10000000:1.0:1787383387.605519:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 587: rc = 0 00100000:10000000:1.0:1787383387.606057:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 600: rc = 0 00100000:10000000:1.0:1787383387.606226:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 600: rc = 0 00100000:10000000:1.0:1787383387.606541:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 600: rc = 0 00100000:10000000:1.0:1787383387.606807:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 600: rc = 0 00100000:10000000:1.0:1787383387.607147:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 600: rc = 0 00100000:10000000:1.0:1787383387.607851:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 600: rc = 0 00100000:10000000:1.0:1787383387.608128:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 600: rc = 0 00100000:10000000:1.0:1787383387.608516:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 600: rc = 0 00100000:10000000:1.0:1787383387.608798:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 600: rc = 0 00100000:10000000:1.0:1787383387.609164:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 600: rc = 0 00100000:10000000:1.0:1787383387.609403:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 600: rc = 0 00100000:10000000:1.0:1787383387.610410:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 600: rc = 0 00100000:10000000:1.0:1787383387.610684:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 600: rc = 0 00100000:10000000:1.0:1787383387.611011:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 600: rc = 0 00100000:10000000:1.0:1787383387.611189:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 600: rc = 0 00100000:10000000:1.0:1787383387.611527:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 600: rc = 0 00100000:10000000:1.0:1787383387.611805:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 600: rc = 0 00100000:10000000:1.0:1787383387.612128:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 600: rc = 0 00100000:10000000:1.0:1787383387.612409:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 600: rc = 0 00100000:10000000:1.0:1787383387.612775:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 600: rc = 0 00100000:10000000:1.0:1787383387.613001:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 600: rc = 0 00100000:10000000:1.0:1787383387.613191:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 600: rc = 0 00100000:10000000:1.0:1787383387.613378:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 600: rc = 0 00100000:10000000:1.0:1787383387.613636:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 600: rc = 0 00100000:10000000:1.0:1787383387.613927:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 600: rc = 0 00100000:10000000:1.0:1787383387.614160:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 600: rc = 0 00100000:10000000:1.0:1787383387.614401:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 600: rc = 0 00100000:10000000:1.0:1787383387.614667:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 600: rc = 0 00100000:10000000:1.0:1787383387.615552:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 600: rc = 0 00100000:10000000:1.0:1787383387.618141:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 600: rc = 0 00100000:10000000:1.0:1787383387.618413:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 600: rc = 0 00100000:10000000:1.0:1787383387.618928:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 600: rc = 0 00100000:10000000:1.0:1787383387.619290:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:1.0:1787383387.621700:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787383387.621946:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 584: rc = 0 00100000:10000000:1.0:1787383387.622159:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787383387.622216:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 584: rc = 0 00100000:10000000:1.0:1787383387.622509:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787383387.623003:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 584: rc = 0 00100000:10000000:1.0:1787383387.623483:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787383387.623552:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 580: rc = 0 00100000:10000000:1.0:1787383387.623752:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787383387.623811:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 580: rc = 0 00100000:10000000:1.0:1787383387.624201:0:14162:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787383387.624260:0:14162:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 580: rc = 0 00000020:00000080:1.0:1787383387.625343:0:14162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787383387.625404:0:14162:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383387.625414:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfa85 00000020:01000004:1.0:1787383387.625422:0:14162:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787383387.625428:0:14162:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787383387.625433:0:14162:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffb037d9000 from MGS 00000020:01000004:1.0:1787383387.625442:0:14162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787383387.625452:0:14162:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ffc17098000) 00000020:00000080:1.0:1787383387.625462:0:14162:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787383387.625516:0:14162:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffb037d9000 from MGS, refs=2 00080000:01000000:1.0:1787383387.625521:0:14162:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383387.625526:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfa93 00000100:00100000:1.0:1787383387.625700:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787383387.625816:0:14162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787383387.625822:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787383387.626513:0:14162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787383387.626520:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787383387.627469:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383387.627820:0:14162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787383387.627837:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787383387.628588:0:14162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787383387.628599:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787383387.629005:0:14162:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787383387.629012:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787383387.630027:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.630032:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.630035:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.630517:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.630520:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.630522:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383387.631957:0:14162:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787383387.636204:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787383387.643506:0:14162:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787383387.643525:0:14162:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787383387.643529:0:14162:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787383387.644972:0:14171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787383387.645135:0:14162:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787383387.645230:0:14162:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787383387.645704:0:14162:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787383387.646079:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383387.646215:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787383387.646221:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787383387.652509:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787383387.652525:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787383387.655359:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787383387.655375:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787383387.656216:0:14162:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787383387.656235:0:14162:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:3.0:1787383387.656236:0:14162:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787383387.656259:0:14162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:3.0:1787383387.656269:0:14162:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (ffff9ffc3dc7cd40) 00000020:00000080:3.0:1787383387.656281:0:14162:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787383387.656352:0:14162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc2fd6d800@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00000100:00080000:0.0:1787383387.656483:0:14176:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1787383387.656692:0:14162:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:3.0:1787383387.656698:0:14162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787383387.657205:0:14177:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787383387.657269:0:14162:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid fb4211d2-6362-43cb-a936-032e5733e3e9) 00000020:00000080:3.0:1787383387.657283:0:14162:0:(genops.c:1406:class_connect()) connect: client fb4211d2-6362-43cb-a936-032e5733e3e9, cookie 0x42020b050d5cfaa1 00000100:00080000:3.0:1787383387.657293:0:14162:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383387.657299:0:14162:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffff9ffc2fd6d800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1787383387.657338:0:14162:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc2d714000 x1874206979609728/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383387.657364:0:14162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fb4211d2-6362-43cb-a936-032e5733e3e9->MGS 00000020:01000004:3.0:1787383387.657380:0:14162:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787383387.657384:0:14162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787383387.657393:0:14162:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ffc3dc78000) 00000100:00100000:1.0:1787383387.657472:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb4211d2-6362-43cb-a936-032e5733e3e9:3311:1874206979609728:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787383387.657538:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383387.657605:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979609728 00000100:00100000:1.0:1787383387.657611:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979609728 00000100:00100000:1.0:1787383387.657634:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383387.657639:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1874206979609728:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787383387.657727:0:14172:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fb4211d2-6362-43cb-a936-032e5733e3e9@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1787383387.657745:0:14172:0:(genops.c:1406:class_connect()) connect: client fb4211d2-6362-43cb-a936-032e5733e3e9, cookie 0x42020b050d5cfaaf 00000100:00080000:1.0:1787383387.657843:0:14172:0:(import.c:65:import_set_state_nolock()) ffff9ffc2170f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383387.657917:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+5:3311:x1874206979609728:12345-0@lo:250:mount.lustre.0 Request processed in 275us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.657925:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383387.657962:0:3311:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787383387.657968:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:1.0:1787383387.657974:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787383387.657976:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787383387.657979:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc2fd6d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787383387.657981:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787383387.657985:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787383387.657989:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb4211d2-6362-43cb-a936-032e5733e3e9:3311:1874206979609728:0@lo:250:mount.lustre.0 00000020:00000080:3.0:1787383387.659797:0:14162:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787383387.679668:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383387.679808:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383387.679812:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787383387.682393:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383387.682460:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787383387.683035:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383387.683042:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787383387.683817:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383387.684421:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787383387.684427:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787383387.685102:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787383387.685110:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787383387.783428:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383387.783681:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787383387.783688:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787383387.787085:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787383387.787105:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787383387.792553:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383387.792779:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787383387.792787:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787383387.796731:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787383387.796753:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787383387.797779:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383387.807763:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787383387.807776:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787383387.810225:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383387.810241:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787383387.811417:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383387.811641:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787383387.811648:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787383387.817392:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383387.817417:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787383387.876936:0:14162:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383387.877136:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383387.877143:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787383387.882228:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787383387.882256:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787383387.891275:0:14162:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787383387.891289:0:14162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787383387.892937:0:14162:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787383387.892964:0:14162:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787383387.892971:0:14162:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787383387.893356:0:14162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787383387.893394:0:14162:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787383387.893400:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787383387.893401:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383387.893402:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383387.893404:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383387.893404:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383387.893406:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383387.893407:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383387.893408:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383387.893410:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383387.893411:0:14162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383387.893414:0:14162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787383387.893416:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383387.893417:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383387.893418:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383387.893419:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383387.893420:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383387.893421:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383387.893422:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383387.893423:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383387.893424:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383387.893425:0:14162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383387.893458:0:14162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787383387.893478:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979609856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383387.893556:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.893649:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffb022e7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383387.893770:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979609856 00000100:00100000:0.0:1787383387.893783:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979609856 00000100:00100000:0.0:1787383387.893969:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383387.893979:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+5:14162:x1874206979609856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383387.894057:0:14175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787383387.894060:0:14175:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787383387.894064:0:14175:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787383387.896917:0:14196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787383387.897494:0:14175:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787383387.900864:0:14197:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787383387.900897:0:14197:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787383387.900900:0:14197:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787383387.900965:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787383387.901708:0:14175:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787383387.901730:0:14175:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787383387.914098:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+5:14162:x1874206979609856:12345-0@lo:253:mount.lustre.0 Request processed in 20109us (20531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.914187:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383387.914328:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979609856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787383387.914359:0:14162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787383387.914362:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383387.914363:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383387.914365:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383387.914366:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383387.914367:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383387.914368:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383387.914370:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383387.914371:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383387.914593:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383387.914595:0:14162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787383387.914619:0:14162:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffb037d9000 from lustre-MDT0000 10000000:01000000:2.0:1787383387.914649:0:14162:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787383387.914652:0:14162:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787383387.914657:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ffc3dc7cd40 10000000:01000000:2.0:1787383387.914662:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383387.914669:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffc3dc7cd40 from 1 10000000:01000000:2.0:1787383387.914672:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787383387.914711:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.914723:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.914750:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383387.914771:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979609984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383387.914810:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.915068:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc274633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383387.919056:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979609984 00000100:00100000:1.0:1787383387.919071:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979609984 00000100:00100000:1.0:1787383387.919179:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383387.919191:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+5:14162:x1874206979609984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383387.919209:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383387.919235:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5cfabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfab6 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383387.919263:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5cfabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfab6 expref: 6 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383387.919290:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6a200/0x42020b050d5cfabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfab6 expref: 6 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383387.919298:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a200, rc 0) 00000100:00100000:1.0:1787383387.919402:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+6:14162:x1874206979609984:12345-0@lo:101:mount.lustre.0 Request processed in 214us (4591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.919409:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383387.919524:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979609984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383387.919544:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.919567:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383387.919639:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383387.919689:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383387.920308:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383387.920475:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610112 00000100:00100000:2.0:1787383387.920481:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610112 00000100:00100000:2.0:1787383387.920621:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383387.920630:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+6:14162:x1874206979610112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383387.921188:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+6:14162:x1874206979610112:12345-0@lo:501:mount.lustre.0 Request processed in 558us (1497us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383387.921197:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383387.921295:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787383387.921332:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787383387.921366:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921384:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383387.921394:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffb037d9000 10000000:01000000:3.0:1787383387.921399:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787383387.921404:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ffb037d9000 10000000:01000000:3.0:1787383387.921407:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787383387.921410:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ffb037d9000 from 1 10000000:01000000:3.0:1787383387.921413:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787383387.921444:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921452:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921462:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383387.921488:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383387.921536:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383387.921565:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383387.921587:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610240 00000100:00100000:3.0:1787383387.921592:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610240 00000100:00100000:3.0:1787383387.921613:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383387.921620:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+6:14162:x1874206979610240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383387.921630:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383387.921643:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5cfacb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfac4 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921674:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5cfacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfac4 expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921684:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98c00/0x42020b050d5cfacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfac4 expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921693:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98c00, rc 0) 00000100:00100000:3.0:1787383387.921723:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+7:14162:x1874206979610240:12345-0@lo:101:mount.lustre.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383387.921729:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383387.921767:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383387.921778:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfacb expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921785:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfacb expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383387.921806:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787383387.921810:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfacb expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921816:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99c00/0x42020b050d5cfac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfacb expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383387.921821:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787383387.921834:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383387.921839:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ffb037d9000 10000000:01000000:3.0:1787383387.921841:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787383387.921844:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787383387.921846:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383387.921859:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921865:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.921898:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383387.921910:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383387.921934:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383387.921959:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383387.921974:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610368 00000100:00100000:3.0:1787383387.921978:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610368 00000100:00100000:3.0:1787383387.921996:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383387.922008:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+7:14162:x1874206979610368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383387.922016:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383387.922024:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5cfad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfad2 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.922038:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5cfad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfad2 expref: 8 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.922046:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98a00/0x42020b050d5cfad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfad2 expref: 8 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.922052:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98a00, rc 0) 00000100:00100000:3.0:1787383387.922080:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+8:14162:x1874206979610368:12345-0@lo:101:mount.lustre.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383387.922087:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383387.922118:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383387.922128:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfad9 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.922135:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfad9 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383387.922177:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383387.922201:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383387.922214:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383387.922227:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610496 00000100:00100000:3.0:1787383387.922231:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610496 00000100:00100000:3.0:1787383387.922246:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383387.922259:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+8:14162:x1874206979610496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383387.922590:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14162:x1874206979610496:12345-0@lo:501:mount.lustre.0 Request processed in 330us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383387.922597:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383387.922630:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383387.922658:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383387.922699:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383387.922714:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383387.922726:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610624 00000100:00100000:3.0:1787383387.922730:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610624 00000100:00100000:3.0:1787383387.922747:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383387.922753:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14162:x1874206979610624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383387.923074:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14162:x1874206979610624:12345-0@lo:503:mount.lustre.0 Request processed in 320us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383387.923082:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383387.923123:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979610624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383387.926078:0:14198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14198:1874206979610752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383387.926158:0:14198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.926243:0:14198:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383387.926294:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979610752 00000100:00100000:3.0:1787383387.926302:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979610752 00000100:00100000:3.0:1787383387.926493:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383387.926577:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14198:x1874206979610752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383387.927187:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14198:x1874206979610752:12345-0@lo:502:llog_process_th.0 Request processed in 613us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383387.927197:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383387.927310:0:14198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14198:1874206979610752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383387.927461:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383387.927474:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383387.927476:0:14198:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787383387.927483:0:14198:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787383387.927487:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383387.927570:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ffc3d024d40) 00000020:00000080:2.0:1787383387.927589:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787383387.927596:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787383387.927735:0:14198:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787383387.927751:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfae7 00000020:00000080:2.0:1787383387.928134:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787383387.928139:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383387.928144:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383387.928146:0:14198:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787383387.928149:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383387.928152:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383387.928154:0:14198:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787383387.928157:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383387.928167:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ffc3d0219c0) 00000020:00000080:2.0:1787383387.928178:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787383387.928181:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787383387.928183:0:14198:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787383387.928187:0:14198:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787383387.928193:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383387.928242:0:14198:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffb037d9000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787383387.928256:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ffc3d023380) 00000020:00000080:2.0:1787383387.928264:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787383387.928315:0:14198:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787383387.928322:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cfafc 00000020:00000080:2.0:1787383387.929129:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787383387.929137:0:14198:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787383387.929146:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42020b050d5cfb03 00080000:01000000:2.0:1787383387.929153:0:14198:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787383387.929158:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfb0a 00010000:00010000:3.0:1787383388.047609:0:14198:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787383388.048220:0:14198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787383388.048626:0:14198:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787383388.049336:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ffc3dc799c0) 00000020:00000080:3.0:1787383388.049440:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787383388.049579:0:14198:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787383388.049592:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfb18 00000020:00000080:2.0:1787383388.052637:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787383388.062943:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42020b050d5cfb1f 00000020:00000080:3.0:1787383388.063538:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787383388.063552:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.063559:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.063561:0:14198:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787383388.063566:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383388.063572:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.063574:0:14198:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787383388.063579:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787383388.063623:0:14198:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787383388.063640:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.063644:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.063645:0:14198:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787383388.063648:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787383388.063650:0:14198:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1787383388.063652:0:14198:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383388.063653:0:14198:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383388.063655:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787383388.063657:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.063658:0:14198:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787383388.063660:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787383388.063663:0:14198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787383388.063666:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.063668:0:14198:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787383388.063671:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787383388.063677:0:14198:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1787383388.063703:0:14198:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787383388.063706:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383388.063729:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ffc3dc7b380) 00000020:00000080:3.0:1787383388.063743:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787383388.063749:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787383388.063805:0:14198:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787383388.063811:0:14198:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787383388.063818:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfb2d 00010000:00080000:3.0:1787383388.063861:0:14198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc3c82b000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1787383388.064377:0:14198:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787383388.065158:0:14198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787383388.065215:0:14198:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787383388.066572:0:14198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383388.066647:0:14198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787383388.066721:0:14198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787383388.070325:0:14202:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787383388.070333:0:14202:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787383388.071288:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383388.071300:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787383388.071335:0:14198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787383388.071356:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cfb34 00000100:00080000:3.0:1787383388.071367:0:14198:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383388.071373:0:14198:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffc3c82b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1787383388.071408:0:14198:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc2d717100 x1874206979610880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383388.071477:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979610880:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383388.071627:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206979610880 offset 0 length 520: 4 00000100:00080000:3.0:1787383388.071689:0:14198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787383388.071750:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.071755:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.071757:0:14198:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787383388.071760:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787383388.071763:0:14198:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787383388.071764:0:14198:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383388.071766:0:14198:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383388.071767:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787383388.071770:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.071776:0:14198:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787383388.071780:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787383388.071784:0:14198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787383388.071788:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.071789:0:14198:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787383388.071792:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787383388.071795:0:14198:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1787383388.071815:0:14198:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787383388.071817:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383388.071841:0:14198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ffc173ecd40) 00000020:00000080:3.0:1787383388.071854:0:14198:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787383388.071859:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787383388.072134:0:14198:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787383388.072139:0:14198:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787383388.072153:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42020b050d5cfb42 00010000:00080000:3.0:1787383388.072193:0:14198:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc349c2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1787383388.072401:0:14198:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787383388.072611:0:14198:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787383388.072633:0:14198:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787383388.073462:0:14198:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383388.073537:0:14198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787383388.073608:0:14198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787383388.074328:0:14204:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383388.074333:0:14204:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787383388.075419:0:14198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383388.075431:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787383388.075467:0:14198:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787383388.075486:0:14198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cfb49 00000100:00080000:3.0:1787383388.075563:0:14198:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383388.075571:0:14198:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffc349c2000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1787383388.075607:0:14198:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc2d715880 x1874206979611008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383388.075673:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979611008:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383388.075731:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206979611008 offset 0 length 520: 4 00000100:00080000:3.0:1787383388.075782:0:14198:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787383388.075894:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.075899:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.075901:0:14198:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787383388.075904:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383388.075908:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.075909:0:14198:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383388.075913:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383388.075915:0:14198:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787383388.075917:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.075919:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.075920:0:14198:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787383388.075922:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383388.075924:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.075925:0:14198:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383388.075929:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787383388.076071:0:14198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14198:1874206979611136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383388.076127:0:14198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383388.076162:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611136 00000100:00100000:3.0:1787383388.076168:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611136 00000100:00100000:3.0:1787383388.076210:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383388.076219:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14198:x1874206979611136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383388.076468:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14198:x1874206979611136:12345-0@lo:502:llog_process_th.0 Request processed in 249us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.076475:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383388.076722:0:14198:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc03438540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383388.076745:0:14198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14198:1874206979611136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383388.076770:0:14198:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383388.076776:0:14198:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383388.076778:0:14198:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787383388.076782:0:14198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787383388.077080:0:14162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787383388.077103:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787383388.077158:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfad9 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.077170:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99800/0x42020b050d5cfad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfad9 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383388.077189:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffb037d9000 from 1 10000000:01000000:2.0:1787383388.077192:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383388.077223:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.077231:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.077240:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.077256:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383388.077293:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.077353:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383388.077410:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611264 00000100:00100000:3.0:1787383388.077415:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611264 00000100:00100000:3.0:1787383388.077479:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383388.077488:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+9:14162:x1874206979611264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383388.077570:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383388.077587:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfb50 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.077610:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 10 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.077620:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 10 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.077629:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98e00, rc 0) 00000100:00100000:3.0:1787383388.077704:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+10:14162:x1874206979611264:12345-0@lo:101:mount.lustre.0 Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.077710:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383388.077788:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383388.077801:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.077809:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.078415:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611392:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787383388.078457:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.078614:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383388.078678:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611392 00000100:00100000:3.0:1787383388.078683:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611392 00000100:00100000:3.0:1787383388.078720:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383388.078728:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+10:14162:x1874206979611392:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787383388.078742:0:14174:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787383388.078747:0:14174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787383388.078817:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+10:14162:x1874206979611392:12345-0@lo:256:mount.lustre.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.078835:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383388.078973:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611392:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787383388.079644:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383388.079728:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.079738:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383388.079746:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffb037d9000 from 1 10000000:01000000:2.0:1787383388.079749:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383388.079778:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.079786:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.079794:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.079812:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383388.079865:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.079914:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383388.080039:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611520 00000100:00100000:3.0:1787383388.080046:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611520 00000100:00100000:3.0:1787383388.080093:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383388.080101:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+10:14162:x1874206979611520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383388.080112:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383388.080125:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfb5e expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.080145:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.080156:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383388.080166:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99400, rc 0) 00000100:00100000:3.0:1787383388.080206:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979611520:12345-0@lo:101:mount.lustre.0 Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.080212:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383388.080316:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383388.080328:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.080336:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.080384:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383388.080409:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.080447:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383388.080488:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611648 00000100:00100000:3.0:1787383388.080493:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611648 00000100:00100000:3.0:1787383388.080622:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383388.080630:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979611648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383388.081059:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979611648:12345-0@lo:501:mount.lustre.0 Request processed in 430us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.081066:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383388.081158:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383388.081190:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383388.081228:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.081376:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.081665:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611776 00000100:00100000:0.0:1787383388.081671:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611776 00000100:00100000:0.0:1787383388.081697:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383388.081706:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979611776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383388.081906:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979611776:12345-0@lo:503:mount.lustre.0 Request processed in 201us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.081914:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383388.082004:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979611776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383388.082345:0:14206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14206:1874206979611904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383388.082384:0:14206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383388.082404:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979611904 00000100:00100000:0.0:1787383388.082408:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979611904 00000100:00100000:0.0:1787383388.082426:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383388.082432:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14206:x1874206979611904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383388.082688:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14206:x1874206979611904:12345-0@lo:502:llog_process_th.0 Request processed in 255us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.082695:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383388.082739:0:14206:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc01370240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.082754:0:14206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14206:1874206979611904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383388.082776:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383388.082785:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.082787:0:14206:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383388.082797:0:14206:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffb037d9000 00000020:00000080:0.0:1787383388.082799:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383388.082806:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383388.082809:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.082810:0:14206:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383388.082813:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383388.082815:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.082816:0:14206:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383388.082820:0:14206:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffb037d9000 00000020:00000080:0.0:1787383388.082822:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383388.083198:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383388.083203:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.083205:0:14206:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383388.083208:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383388.083211:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.083213:0:14206:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383388.083216:0:14206:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffb037d9000 00000020:00000080:0.0:1787383388.083218:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383388.090075:0:14206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14206:1874206979612032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383388.090163:0:14206:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383388.090203:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612032 00000100:00100000:0.0:1787383388.090210:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612032 00000100:00100000:0.0:1787383388.090264:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383388.090274:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14206:x1874206979612032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383388.090486:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14206:x1874206979612032:12345-0@lo:502:llog_process_th.0 Request processed in 213us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.090513:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383388.090562:0:14206:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff2af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.090582:0:14206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14206:1874206979612032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383388.090604:0:14206:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383388.090611:0:14206:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383388.090613:0:14206:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787383388.090620:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787383388.096992:0:14162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787383388.097030:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383388.097059:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.097073:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383388.097125:0:14162:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787383388.097128:0:14162:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffb037d9000 10000000:01000000:2.0:1787383388.097131:0:14162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffb037d9000 10000000:01000000:2.0:1787383388.097134:0:14162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383388.097140:0:14162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffb037d9000 from 1 10000000:01000000:2.0:1787383388.097143:0:14162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383388.097181:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.097191:0:14162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.097202:0:14162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.097237:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383388.097305:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.097341:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.097430:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612160 00000100:00100000:0.0:1787383388.097438:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612160 00000100:00100000:0.0:1787383388.097490:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383388.097567:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979612160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383388.097582:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383388.097598:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17046600/0x42020b050d5cfb73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfb6c expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.097624:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046600/0x42020b050d5cfb73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfb6c expref: 12 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.097635:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17046600/0x42020b050d5cfb73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb6c expref: 12 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.097644:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046600, rc 0) 00000100:00100000:0.0:1787383388.097684:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612160:12345-0@lo:101:mount.lustre.0 Request processed in 186us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.097691:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383388.098011:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383388.098026:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb73 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.098034:0:14162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfb73 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.098084:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383388.098112:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.100639:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.107615:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612288 00000100:00100000:0.0:1787383388.107630:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612288 00000100:00100000:0.0:1787383388.107693:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383388.107710:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383388.108076:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612288:12345-0@lo:501:mount.lustre.0 Request processed in 366us (9961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.108085:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383388.110734:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383388.110798:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383388.110912:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.110953:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383388.110974:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612416 00000100:00100000:2.0:1787383388.110980:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612416 00000100:00100000:2.0:1787383388.111028:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383388.111037:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383388.111221:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612416:12345-0@lo:503:mount.lustre.0 Request processed in 184us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383388.111229:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383388.111286:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383388.112908:0:14211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14211:1874206979612544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383388.112980:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.113014:0:14211:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.113187:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612544 00000100:00100000:0.0:1787383388.113195:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612544 00000100:00100000:0.0:1787383388.113707:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383388.113718:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14211:x1874206979612544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383388.114025:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14211:x1874206979612544:12345-0@lo:502:llog_process_th.0 Request processed in 308us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.114034:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383388.115572:0:14211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14211:1874206979612544:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787383388.115650:0:14211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787383388.115666:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ffc3d020000) 00000020:00000080:2.0:1787383388.115686:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787383388.118239:0:14211:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffb037d9000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383388.118248:0:14211:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffb037d9000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383388.118251:0:14211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffb037d9000 4 00010000:00080000:2.0:1787383388.118289:0:14211:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc34f95000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1787383388.120684:0:14211:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787383388.120814:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787383388.121154:0:14211:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383388.121167:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42020b050d5cfb81 00000100:00080000:2.0:1787383388.121177:0:14211:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383388.121182:0:14211:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ffc34f95000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1787383388.121217:0:14211:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc37fb6300 x1874206979612672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383388.121285:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979612672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383388.121375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383388.121776:0:14211:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383388.122636:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612672 00000100:00100000:0.0:1787383388.122649:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612672 00000100:00100000:0.0:1787383388.122687:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383388.122695:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979612672:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383388.122933:0:14211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14211:1874206979612800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383388.122983:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.123010:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612800 00000100:00100000:2.0:1787383388.123014:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612800 00000100:00100000:2.0:1787383388.123046:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383388.123061:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14211:x1874206979612800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383388.123295:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14211:x1874206979612800:12345-0@lo:502:llog_process_th.0 Request processed in 234us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383388.123303:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383388.123365:0:14211:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383388.123386:0:14211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb4211d2-6362-43cb-a936-032e5733e3e9:14211:1874206979612800:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787383388.123413:0:14211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787383388.123466:0:14162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787383388.123485:0:14162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383388.123576:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb73 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.123588:0:14162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d600/0x42020b050d5cfb6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb73 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383388.123636:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383388.123638:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383388.123639:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383388.123641:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383388.123642:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383388.123644:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383388.123645:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383388.123647:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383388.123649:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383388.123650:0:14162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383388.123655:0:14162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787383388.123657:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383388.123658:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383388.123659:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383388.123660:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383388.123661:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383388.123662:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383388.123668:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383388.123668:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383388.123670:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383388.123671:0:14162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383388.123685:0:14162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787383388.123696:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383388.123732:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.123747:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc27463600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.124092:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979612672:12345-0@lo:38:llog_process_th.0 Request processed in 1395us (2715us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787383388.124101:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383388.124137:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979612928 00000100:00100000:0.0:1787383388.124141:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979612928 00000100:00100000:0.0:1787383388.124175:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383388.124183:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14162:x1874206979612928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383388.124203:0:14172:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787383388.124216:0:14172:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787383388.125959:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383388.125977:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc34f95000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383388.125983:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787383388.125987:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979612672:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787383388.166481:0:14172:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787383388.166507:0:14172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787383388.166748:0:14196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383388.166754:0:14196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383388.166783:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.166802:0:14196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.166811:0:14196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.166861:0:14196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.166908:0:14196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 12 pid: 14174 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383388.166925:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979613056:0@lo:104: 00000100:00100000:2.0:1787383388.166989:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.167032:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2746a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383388.167119:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613056 00000100:00100000:0.0:1787383388.167138:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613056 00000100:00100000:0.0:1787383388.167183:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383388.167192:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979613056:12345-0@lo:104: 00010000:00010000:0.0:1787383388.167204:0:14163:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167255:0:14163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383388.167262:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979613056:12345-0@lo:104: Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.167269:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383388.167311:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979613056:0@lo:104: 00010000:00010000:0.0:1787383388.167330:0:14196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167347:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383388.167353:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167360:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383388.167365:0:14169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167373:0:14169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383388.167380:0:14169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383388.167386:0:14169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383388.167494:0:14169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167510:0:14169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383388.167529:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167536:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfb50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb57 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383388.167553:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383388.167555:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383388.167556:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383388.167586:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb4211d2-6362-43cb-a936-032e5733e3e9:3314:1874206979613184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383388.167617:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383388.168268:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613184 00000100:00100000:1.0:1787383388.168275:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613184 00010000:00010000:1.0:1787383388.168297:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 13 pid: 14174 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383388.168323:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383388.168339:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+13:3314:x1874206979613184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383388.168351:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383388.168357:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 13 pid: 14174 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168368:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 13 pid: 14174 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168381:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e98e00/0x42020b050d5cfb57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfb50 expref: 13 pid: 14174 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168829:0:14165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168840:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383388.168855:0:14165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002102754s 00010000:00010000:1.0:1787383388.168860:0:14165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168951:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168960:0:14165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168966:0:14165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168972:0:14165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519de00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383388.168983:0:14165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.168991:0:14165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.169274:0:14196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383388.169283:0:14196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.169321:0:14165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.169329:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3519de00/0x42020b050d5cfb88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383388.169346:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383388.169582:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3314:x1874206979613184:12345-0@lo:103:ldlm_bl.0 Request processed in 1241us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383388.169591:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383388.174787:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb4211d2-6362-43cb-a936-032e5733e3e9:3314:1874206979613184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383388.175253:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14162:x1874206979612928:12345-0@lo:253:mount.lustre.0 Request processed in 51067us (51516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383388.175265:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383388.175349:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14162:1874206979612928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383388.175363:0:14162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787383388.175367:0:14162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383388.175368:0:14162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787383388.175370:0:14162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383388.175371:0:14162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383388.175372:0:14162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383388.175373:0:14162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383388.175374:0:14162:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383388.175376:0:14162:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787383388.175378:0:14162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383388.175379:0:14162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383388.175391:0:14162:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787383388.181216:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.181469:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383388.181839:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.182035:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383388.182319:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.182631:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383388.184685:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.184958:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383388.185239:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.185616:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787383388.185926:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787383388.186087:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787383388.213007:0:14162:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787383388.213433:0:14162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787383388.213812:0:14219:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787383388.213925:0:14219:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787383388.216916:0:14162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787383388.217049:0:14162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787383388.217455:0:14162:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787383388.217462:0:14162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787383388.217588:0:14162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787383388.219679:0:14218:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787383388.219690:0:14218:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787383388.220157:0:14219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383388.220237:0:14219:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787383388.220241:0:14219:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787383388.224017:0:14162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787383388.225047:0:14162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787383388.225095:0:14162:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787383388.227861:0:14162:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787383388.235226:0:14162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787383388.272325:0:14162:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787383388.272370:0:14162:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc36401c77988 00100000:10000000:2.0:1787383388.272379:0:14162:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787383388.273163:0:14162:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383388.273180:0:14162:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383388.273198:0:14162:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787383388.273225:0:14162:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787383388.681985:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383389.130943:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787383389.394522:0:14177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383389.394531:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffb037d9000 from 6 10000000:01000000:2.0:1787383389.394537:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383389.394601:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.394615:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.394627:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383389.394667:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979613312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383389.394736:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383389.394795:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc06401780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383389.395067:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613312 00000100:00100000:0.0:1787383389.395075:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613312 00000100:00100000:2.0:1787383389.395387:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383389.395399:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14177:x1874206979613312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383389.395413:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383389.395429:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfb8f expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.395454:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 12 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.395464:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 12 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.395473:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d000, rc 0) 00000100:00100000:2.0:1787383389.395583:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979613312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383389.395590:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383389.395710:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979613312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383389.395726:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383389.395735:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383389.395789:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979613440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383389.395838:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383389.396176:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3ff2acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383389.396214:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613440 00000100:00100000:2.0:1787383389.396220:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613440 00000100:00100000:2.0:1787383389.396347:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383389.396356:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979613440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383389.396371:0:14172:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383389.396387:0:14172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383389.396390:0:14172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787383389.396481:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979613440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383389.396489:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383389.396557:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979613440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787383389.396613:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383389.396621:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383389.396630:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383389.707272:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383390.155354:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383390.735272:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383391.755032:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383392.756424:0:14461:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787383392.782677:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383393.548135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383393.548141:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383393.548144:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383393.548148:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383393.548151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787383393.548154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383393.548159:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ffc34f95000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383393.548171:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ffc34f95000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1787383393.548194:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc37fb5500 x1874206979613696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383393.548254:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979613568:0@lo:400:kworker.0 00000100:00100000:1.0:1787383393.548337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383393.548402:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979613696:0@lo:38:kworker.0 00000100:00100000:1.0:1787383393.548432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383393.548491:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613696 00000100:00100000:1.0:1787383393.548498:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613696 00000100:00100000:1.0:1787383393.548532:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383393.548540:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1874206979613696:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787383393.548565:0:14182:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:1.0:1787383393.548606:0:14182:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42020b050d5cfb9d 00000004:00100000:1.0:1787383393.548622:0:14182:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383393.548757:0:14182:0:(import.c:65:import_set_state_nolock()) ffff9ffc27508800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383393.548821:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874206979613696:12345-0@lo:38:kworker.0 Request processed in 280us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383393.548846:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383393.548917:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc37fb5500 x1874206979613696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383393.548931:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787383393.548939:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787383393.548944:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383393.548947:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc34f95000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383393.548953:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874206979613696:0@lo:38:kworker.0 00000100:00100000:2.0:1787383393.549153:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613568 00000100:00100000:2.0:1787383393.549158:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613568 00000100:00100000:2.0:1787383393.549201:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383393.549209:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3315:x1874206979613568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383393.549250:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3315:x1874206979613568:12345-0@lo:400:kworker.0 Request processed in 42us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383393.549257:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383393.550007:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979613568:0@lo:400:kworker.0 00010000:00010000:2.0:1787383393.802034:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383394.829445:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383395.851557:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383396.078120:0:14612:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffde931d850 00000020:00000080:3.0:1787383396.078138:0:14612:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383396.078144:0:14612:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383396.078158:0:14612:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde931fae0 20000000:00000080:3.0:1787383396.078166:0:14612:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc2e8eb800 uarg=0000000000000000 20000000:01000000:3.0:1787383396.078207:0:14612:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787383396.078216:0:14612:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787383396.078222:0:14612:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787383396.081711:0:14613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787383396.081898:0:14612:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787383396.092725:0:14612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787383396.092771:0:14612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.092792:0:14612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.092802:0:14612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.092846:0:14612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.092861:0:14612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383396.092943:0:14612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14612:1874206979613824:0@lo:104: 00000100:00100000:1.0:1787383396.093020:0:14612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383396.093085:0:14612:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383396.094685:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613824 00000100:00100000:3.0:1787383396.094699:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613824 00000100:00100000:3.0:1787383396.094767:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383396.094777:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14612:x1874206979613824:12345-0@lo:104: 00010000:00010000:3.0:1787383396.094794:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.094891:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383396.094898:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14612:x1874206979613824:12345-0@lo:104: Request processed in 122us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383396.094905:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787383396.094929:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383396.094935:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.094943:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383396.094946:0:14168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.094955:0:14168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383396.094962:0:14168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383396.094989:0:14168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383396.095026:0:14168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.095033:0:14168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383396.095066:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.095073:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfb5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb65 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383396.095091:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383396.095093:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383396.095094:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383396.095118:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383396.095131:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979613952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383396.095180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383396.095798:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979613952 00000100:00100000:2.0:1787383396.095812:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979613952 00010000:00010000:2.0:1787383396.095839:0:14166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 12 pid: 14174 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383396.095904:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383396.095912:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3313:x1874206979613952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383396.095923:0:14166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383396.095929:0:14166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 12 pid: 14174 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095940:0:14166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 12 pid: 14174 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095958:0:14166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095965:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095980:0:14166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095987:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095994:0:14166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.095999:0:14166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.096005:0:14166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383396.096015:0:14166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.096023:0:14166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.096031:0:14166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383396.096116:0:14166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383396.096164:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3313:x1874206979613952:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383396.096172:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383396.096216:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979613952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383396.096707:0:14612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99400/0x42020b050d5cfb65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfb5e expref: 11 pid: 14174 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383396.096721:0:14612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14612:1874206979613824:0@lo:104: 00010000:00010000:1.0:1787383396.096739:0:14612:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.096762:0:14612:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.096769:0:14612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.096775:0:14612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfba4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383396.874101:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787383397.385926:0:14177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383397.385934:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffb037d9000 from 10 10000000:01000000:2.0:1787383397.385938:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383397.385984:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383397.385994:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383397.386005:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383397.386027:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383397.386088:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.386133:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383397.386204:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614080 00000100:00100000:3.0:1787383397.386212:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614080 00000100:00100000:3.0:1787383397.386262:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383397.386270:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+11:14177:x1874206979614080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383397.386284:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383397.386296:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfbab expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383397.386326:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfbab expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383397.386337:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbab expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383397.386357:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99000, rc 0) 00000100:00100000:3.0:1787383397.386391:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979614080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383397.386398:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383397.386577:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383397.386601:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383397.386610:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383397.386657:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383397.386680:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.386703:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383397.388112:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614208 00000100:00100000:3.0:1787383397.388122:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614208 00000100:00100000:3.0:1787383397.388171:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383397.388180:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979614208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383397.389197:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979614208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1014us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383397.389208:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787383397.389319:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383397.389427:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383397.389500:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.389538:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383397.389561:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614336 00000100:00100000:2.0:1787383397.389565:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614336 00000100:00100000:2.0:1787383397.389598:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383397.389607:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979614336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383397.389964:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14177:x1874206979614336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 354us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383397.389975:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383397.390049:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979614336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383397.392934:0:14673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787383397.393038:0:14177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787383397.393056:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383397.393068:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383397.393095:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383397.898441:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383398.666337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383398.666345:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383398.666348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383398.666351:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383398.666404:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979614592:0@lo:400:kworker.0 00000100:00100000:2.0:1787383398.666484:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383398.666577:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614592 00000100:00100000:2.0:1787383398.666586:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614592 00000100:00100000:2.0:1787383398.666631:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383398.666640:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979614592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383398.666693:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979614592:12345-0@lo:400:kworker.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383398.666701:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787383398.666759:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc37fb4e00 x1874206979614592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383398.666773:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979614592:0@lo:400:kworker.0 00000100:00100000:0.0:1787383398.666947:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383398.666959:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979614464:0@lo:400:kworker.0 00000100:00100000:0.0:1787383398.667000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383398.667128:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614464 00000100:00100000:3.0:1787383398.667133:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614464 00000100:00100000:3.0:1787383398.667162:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383398.667169:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3312:x1874206979614464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383398.667213:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:3312:x1874206979614464:12345-0@lo:400:kworker.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383398.667220:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383398.667256:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979614464:0@lo:400:kworker.0 00000100:00100000:2.0:1787383398.667519:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383388/real 1787383388] req@ffff9ffc2d715880 x1874206979611008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383398.667538:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffc2d715880 x1874206979611008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383398.667568:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383388/real 1787383388] req@ffff9ffc2d717100 x1874206979610880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383398.667580:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffc2d717100 x1874206979610880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383398.667592:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc349c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383398.667604:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383398.667607:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979611008:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787383398.667611:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3c82b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383398.667615:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383398.667618:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979610880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787383398.667679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383398.667683:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787383398.667686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ffc3c82b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383398.667690:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787383398.667694:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383398.667699:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffc3c82b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383398.667742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffb029aed80 x1874206979614720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383398.667775:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383398.667778:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383398.667780:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ffc349c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383398.667783:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787383398.667786:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383398.667789:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffc349c2000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1787383398.667803:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffb029aca80 x1874206979614848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383398.668780:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979614720:0@lo:8:kworker.0 00000400:00000100:2.0:1787383398.668833:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206979614720 offset 0 length 520: 4 00000100:00100000:2.0:1787383398.668864:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979614848:0@lo:8:kworker.0 00000400:00000100:2.0:1787383398.668903:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206979614848 offset 0 length 520: 4 00010000:00010000:1.0:1787383398.925772:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383399.946170:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383400.398348:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787383400.438501:0:14812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383400.438506:0:14812:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787383400.438605:0:14812:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ffc0cefc000 00000020:01000004:1.0:1787383400.438616:0:14812:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787383400.438628:0:14812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787383400.438640:0:14812:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ffc170999c0) 00000020:00000080:1.0:1787383400.438653:0:14812:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787383400.454308:0:14812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787383400.454743:0:14812:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787383400.455395:0:14812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787383400.455695:0:14812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787383400.456681:0:14812:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787383400.456990:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 439: rc = 0 00100000:10000000:2.0:1787383400.457057:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 439: rc = 0 00100000:10000000:2.0:1787383400.457117:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 439: rc = 0 00100000:10000000:2.0:1787383400.457807:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 575: rc = 0 00100000:10000000:2.0:1787383400.458019:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 575: rc = 0 00100000:10000000:2.0:1787383400.458193:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 575: rc = 0 00100000:10000000:2.0:1787383400.458898:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 575: rc = 0 00100000:10000000:2.0:1787383400.459096:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 575: rc = 0 00100000:10000000:2.0:1787383400.459298:0:14812:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 575: rc = 0 00000020:00000080:2.0:1787383400.459823:0:14812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787383400.459841:0:14812:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787383400.460150:0:14812:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42020b050d5cfbc0 00000020:01000004:3.0:1787383400.460159:0:14812:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787383400.460180:0:14812:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787383400.460183:0:14812:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787383400.460193:0:14812:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787383400.460197:0:14812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787383400.460209:0:14812:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ffc173e99c0) 00000020:00000080:3.0:1787383400.460219:0:14812:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787383400.465034:0:14812:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383400.465194:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383400.465201:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787383400.466149:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383400.466159:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787383400.466658:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383400.466665:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787383400.470638:0:14812:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383400.470780:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383400.470784:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787383400.471210:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383400.471216:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787383400.487120:0:14812:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383400.487349:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383400.487356:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787383400.488692:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383400.488702:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787383400.489415:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787383400.489423:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787383400.491272:0:14812:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383400.491513:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383400.491519:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787383400.492240:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383400.492248:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787383400.528851:0:14812:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383400.529347:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787383400.529353:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787383400.535246:0:14812:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383400.535264:0:14812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787383400.535909:0:14812:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787383400.535937:0:14812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787383400.535943:0:14812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787383400.551532:0:14812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383400.551578:0:14812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787383400.551583:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383400.551589:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383400.551591:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383400.551592:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383400.551593:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383400.551594:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383400.551595:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383400.551597:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383400.551598:0:14812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383400.551602:0:14812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787383400.551605:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383400.551606:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383400.551607:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383400.551608:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383400.551608:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383400.551609:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383400.551610:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383400.551611:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383400.551612:0:14812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383400.551653:0:14812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787383400.551675:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979614976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787383400.551763:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383400.551818:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383400.551926:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979614976 00000100:00100000:0.0:1787383400.551935:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979614976 00000100:00100000:0.0:1787383400.551987:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383400.551997:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14812:x1874206979614976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383400.552030:0:14172:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787383400.552033:0:14172:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787383400.552037:0:14172:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787383400.557749:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14812:x1874206979614976:12345-0@lo:253:mount.lustre.0 Request processed in 5744us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383400.557766:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383400.557862:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979614976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787383400.557985:0:14812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787383400.557989:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383400.557991:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787383400.557992:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383400.557993:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383400.557995:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383400.557996:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383400.557998:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383400.558000:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383400.558001:0:14812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787383400.558023:0:14812:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffc0cefc000 from lustre-OST0000 10000000:01000000:3.0:1787383400.558053:0:14812:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787383400.558056:0:14812:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787383400.558063:0:14812:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffc3dc7cd40 local copy 00010000:00010000:3.0:1787383400.558088:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383400.558524:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383400.558567:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383400.558656:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383400.558704:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615104 00000100:00100000:2.0:1787383400.558719:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615104 00000100:00100000:2.0:1787383400.558793:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383400.558803:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14812:x1874206979615104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383400.559005:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14812:x1874206979615104:12345-0@lo:501:mount.lustre.0 Request processed in 203us (437us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383400.559013:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787383400.559094:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615104:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787383400.559108:0:14812:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787383400.559261:0:14812:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787383400.559268:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.559286:0:14812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383400.559309:0:14812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffc0cefc000 10000000:01000000:0.0:1787383400.559319:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787383400.559324:0:14812:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ffc3dc7cd40 10000000:01000000:0.0:1787383400.559327:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787383400.559331:0:14812:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ffc3dc7cd40 from 1 10000000:01000000:0.0:1787383400.559334:0:14812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787383400.559361:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.559369:0:14812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.559377:0:14812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383400.559392:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383400.559729:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.559965:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383400.560050:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615232 00000100:00100000:3.0:1787383400.560056:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615232 00000100:00100000:3.0:1787383400.560086:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383400.560095:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+12:14812:x1874206979615232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383400.560106:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383400.560120:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99600/0x42020b050d5cfbd5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfbce expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560144:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99600/0x42020b050d5cfbd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfbce expref: 13 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560155:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99600/0x42020b050d5cfbd5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbce expref: 13 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560164:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99600, rc 0) 00000100:00100000:3.0:1787383400.560197:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+13:14812:x1874206979615232:12345-0@lo:101:mount.lustre.0 Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383400.560204:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383400.560316:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383400.560331:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbd5 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.560340:0:14812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfbd5 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383400.560358:0:14812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787383400.560370:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbd5 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.560377:0:14812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17046a00/0x42020b050d5cfbce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbd5 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383400.560384:0:14812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383400.560389:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383400.560393:0:14812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787383400.560395:0:14812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383400.560551:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.560558:0:14812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.560580:0:14812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383400.560595:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383400.560637:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.560653:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383400.560700:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615360 00000100:00100000:3.0:1787383400.560704:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615360 00000100:00100000:3.0:1787383400.560733:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383400.560739:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+13:14812:x1874206979615360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383400.560756:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383400.560764:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99e00/0x42020b050d5cfbe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfbdc expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560778:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99e00/0x42020b050d5cfbe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfbdc expref: 14 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560787:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99e00/0x42020b050d5cfbe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbdc expref: 14 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.560793:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99e00, rc 0) 00000100:00100000:3.0:1787383400.560831:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615360:12345-0@lo:101:mount.lustre.0 Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383400.560836:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383400.560916:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383400.560927:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbe3 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.560935:0:14812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfbe3 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383400.561787:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787383400.563189:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383400.563681:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787383400.563740:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787383400.563773:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787383400.563815:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787383400.563847:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787383400.563910:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787383400.563969:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787383400.563977:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787383400.564060:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383400.564120:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.564160:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383400.564521:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615488 00000100:00100000:3.0:1787383400.564528:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615488 00000100:00100000:3.0:1787383400.564564:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383400.564573:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383400.564959:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615488:12345-0@lo:501:mount.lustre.0 Request processed in 386us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383400.564967:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383400.565129:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383400.565177:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383400.565216:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.565373:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383400.565484:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615616 00000100:00100000:3.0:1787383400.565489:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615616 00000100:00100000:3.0:1787383400.565560:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383400.565568:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383400.565894:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615616:12345-0@lo:503:mount.lustre.0 Request processed in 297us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383400.565912:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383400.565994:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383400.567092:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383400.567167:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383400.567234:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.567615:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383400.567663:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615744 00000100:00100000:2.0:1787383400.567671:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615744 00000100:00100000:2.0:1787383400.567704:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787383400.567724:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383400.568126:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615744:12345-0@lo:502:mount.lustre.0 Request processed in 402us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.568134:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787383400.568220:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383400.568644:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787383400.568693:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787383400.568738:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787383400.568784:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787383400.568825:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787383400.568853:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787383400.570517:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787383400.570578:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787383400.570615:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787383400.570665:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787383400.570703:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787383400.570769:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787383400.570816:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383400.571008:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383400.571081:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.571122:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979615872 00000100:00100000:1.0:1787383400.571129:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979615872 00000100:00100000:1.0:1787383400.571204:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383400.571214:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383400.571568:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979615872:12345-0@lo:502:mount.lustre.0 Request processed in 354us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.571577:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383400.571673:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979615872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383400.571759:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787383400.571774:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787383400.572947:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787383400.572958:0:14826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787383400.572965:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383400.572968:0:14826:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787383400.572973:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383400.572999:0:14826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ffc2fba4d40) 00000020:00000080:2.0:1787383400.573021:0:14826:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787383400.573029:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383400.573094:0:14826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc0cefc000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787383400.573102:0:14826:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383400.573112:0:14826:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42020b050d5cfbf1 00010000:00010000:1.0:1787383400.578530:0:14826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787383400.579008:0:14826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787383400.581758:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787383400.582989:0:14826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787383400.583003:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.583009:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583011:0:14826:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787383400.583015:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383400.583023:0:14826:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787383400.583024:0:14826:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383400.583027:0:14826:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383400.583029:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383400.583032:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583033:0:14826:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383400.583036:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383400.583038:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583039:0:14826:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383400.583042:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383400.583044:0:14826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787383400.583045:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.583048:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583049:0:14826:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787383400.583051:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383400.583053:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583054:0:14826:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787383400.583057:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787383400.583108:0:14826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.583112:0:14826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.583113:0:14826:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383400.583116:0:14826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787383400.583371:0:14812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787383400.583400:0:14812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383400.583434:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbe3 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.583448:0:14812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3dc6ac00/0x42020b050d5cfbdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbe3 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383400.583456:0:14812:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc0cefc000 from 1 10000000:01000000:0.0:1787383400.583458:0:14812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383400.583491:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.583505:0:14812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.583514:0:14812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383400.583533:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383400.583590:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.583632:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.583668:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616000 00000100:00100000:1.0:1787383400.583675:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616000 00000100:00100000:1.0:1787383400.583774:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383400.583784:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+14:14812:x1874206979616000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383400.583798:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383400.583812:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfbf8 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.583835:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 15 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.583846:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 15 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.583862:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a000, rc 0) 00000100:00100000:1.0:1787383400.583925:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616000:12345-0@lo:101:mount.lustre.0 Request processed in 142us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.583932:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787383400.584015:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383400.584030:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.584038:0:14812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383400.584523:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787383400.584887:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383400.585116:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787383400.585158:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787383400.585219:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787383400.585227:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787383400.585286:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383400.585327:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.585358:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.585557:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616128 00000100:00100000:1.0:1787383400.585564:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616128 00000100:00100000:1.0:1787383400.585594:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383400.585602:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383400.585803:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616128:12345-0@lo:501:mount.lustre.0 Request processed in 201us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.585811:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383400.586249:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383400.586282:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383400.586330:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.586440:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.586477:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616256 00000100:00100000:1.0:1787383400.586482:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616256 00000100:00100000:1.0:1787383400.586553:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383400.586561:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383400.586731:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616256:12345-0@lo:503:mount.lustre.0 Request processed in 170us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.586738:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383400.586757:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383400.587465:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383400.587542:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.587666:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.587717:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.587778:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616384 00000100:00100000:1.0:1787383400.587783:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616384 00000100:00100000:1.0:1787383400.587816:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383400.587824:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383400.588002:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616384:12345-0@lo:502:mount.lustre.0 Request processed in 177us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.588009:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383400.588108:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383400.589961:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787383400.590042:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787383400.590096:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787383400.590135:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787383400.590186:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787383400.590234:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787383400.590272:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787383400.590304:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787383400.590350:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.590419:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.590459:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.590734:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616512 00000100:00100000:1.0:1787383400.590742:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616512 00000100:00100000:1.0:1787383400.590795:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383400.590804:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383400.591021:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616512:12345-0@lo:502:mount.lustre.0 Request processed in 217us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.591028:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383400.591352:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383400.591509:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787383400.591520:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787383400.593125:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383400.593138:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593140:0:14830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787383400.593146:0:14830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc0cefc000 00000020:00000080:1.0:1787383400.593149:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383400.593158:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.593160:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593161:0:14830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787383400.593163:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383400.593165:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593166:0:14830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787383400.593169:0:14830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc0cefc000 00000020:00000080:1.0:1787383400.593171:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383400.593234:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.593237:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593239:0:14830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787383400.593241:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383400.593243:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593244:0:14830:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383400.593248:0:14830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffc0cefc000 00000020:00000080:1.0:1787383400.593249:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383400.593360:0:14830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383400.593365:0:14830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383400.593366:0:14830:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787383400.593369:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787383400.593569:0:14812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787383400.593593:0:14812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383400.593609:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.593620:0:14812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383400.593857:0:14812:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383400.593861:0:14812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffc0cefc000 10000000:01000000:0.0:1787383400.593864:0:14812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffc0cefc000 10000000:01000000:0.0:1787383400.593913:0:14812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383400.593919:0:14812:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc0cefc000 from 1 10000000:01000000:0.0:1787383400.593922:0:14812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383400.593959:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.593967:0:14812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.593978:0:14812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383400.594001:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383400.594060:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.594100:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.594168:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616640 00000100:00100000:1.0:1787383400.594174:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616640 00000100:00100000:1.0:1787383400.594214:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383400.594224:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979616640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383400.594240:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383400.594255:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6b400/0x42020b050d5cfc0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfc06 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.594352:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6b400/0x42020b050d5cfc0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfc06 expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.594366:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6b400/0x42020b050d5cfc0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc06 expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383400.594376:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b400, rc 0) 00000100:00100000:1.0:1787383400.594483:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979616640:12345-0@lo:101:mount.lustre.0 Request processed in 260us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.594491:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383400.595388:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383400.595495:0:14812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc0d expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.595504:0:14812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfc0d expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383400.596772:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787383400.598650:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383400.599006:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787383400.599054:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787383400.599089:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787383400.599137:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787383400.599174:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787383400.599238:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787383400.599584:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787383400.599629:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787383400.599678:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787383400.599727:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787383400.599764:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787383400.599813:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787383400.599846:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787383400.599970:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787383400.600024:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787383400.600061:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787383400.600096:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787383400.600145:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787383400.600182:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787383400.600215:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787383400.600397:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787383400.600518:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787383400.600552:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787383400.600600:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787383400.600634:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787383400.600665:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787383400.600736:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787383400.600773:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787383400.600850:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787383400.600858:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787383400.601029:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383400.601093:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.601181:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.601238:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616768 00000100:00100000:1.0:1787383400.601246:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616768 00000100:00100000:1.0:1787383400.601504:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383400.601515:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979616768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383400.601760:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979616768:12345-0@lo:501:mount.lustre.0 Request processed in 246us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.601768:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787383400.601845:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383400.601897:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383400.601941:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.601972:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979616896 00000100:00100000:0.0:1787383400.601976:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979616896 00000100:00100000:0.0:1787383400.601999:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383400.602006:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979616896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383400.602134:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979616896:12345-0@lo:503:mount.lustre.0 Request processed in 128us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383400.602142:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383400.602174:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383400.602189:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979616896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383400.602825:0:14812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383400.602918:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.602962:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.602991:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617024 00000100:00100000:0.0:1787383400.602995:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617024 00000100:00100000:0.0:1787383400.603024:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383400.603031:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979617024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.603200:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979617024:12345-0@lo:502:mount.lustre.0 Request processed in 168us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383400.603208:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383400.603243:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383400.603258:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383400.603703:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787383400.603764:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787383400.603794:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787383400.603838:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787383400.603896:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787383400.603970:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787383400.604019:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787383400.604052:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787383400.604108:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787383400.604147:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787383400.604182:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787383400.605382:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787383400.605536:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787383400.605576:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787383400.605637:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787383400.605677:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787383400.605734:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787383400.605796:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787383400.605828:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787383400.605854:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787383400.605913:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787383400.605962:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787383400.605997:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787383400.606041:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787383400.606070:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787383400.606096:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787383400.606131:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787383400.606162:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787383400.606196:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787383400.607601:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787383400.607674:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787383400.607717:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787383400.607751:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787383400.607803:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787383400.607836:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787383400.607896:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787383400.607932:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787383400.607983:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787383400.608033:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787383400.608077:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787383400.608127:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.608199:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.608254:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617152 00000100:00100000:0.0:1787383400.608261:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617152 00000100:00100000:0.0:1787383400.608380:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383400.608390:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979617152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383400.608675:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979617152:12345-0@lo:502:mount.lustre.0 Request processed in 285us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383400.608684:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383400.608754:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383400.608776:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383400.608841:0:14812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787383400.608851:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787383400.627756:0:14834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787383400.627774:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ffc2fba0000) 00000020:00000080:2.0:1787383400.627800:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787383400.627993:0:14834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc0cefc000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383400.627998:0:14834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc0cefc000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383400.628000:0:14834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc0cefc000 3 00010000:00080000:2.0:1787383400.628029:0:14834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc2aed8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1787383400.632816:0:14834:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787383400.632938:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787383400.632976:0:14834:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383400.632988:0:14834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x42020b050d5cfc1b 00000100:00080000:2.0:1787383400.632999:0:14834:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383400.633005:0:14834:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ffc2aed8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1787383400.633062:0:14834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc37fb4e00 x1874206979617280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383400.633114:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979617280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383400.633184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383400.633231:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617280 00000100:00080000:2.0:1787383400.633234:0:14834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787383400.633239:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617280 00000100:00080000:2.0:1787383400.633254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383400.633259:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383400.633262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383400.633265:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383400.633268:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383400.633276:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1874206979617280:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383400.633303:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979617408:0@lo:400:kworker.0 00000100:00100000:2.0:1787383400.633331:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383400.633362:0:14182:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383400.633369:0:14182:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:1.0:1787383400.633459:0:14180:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1787383400.633490:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42020b050d5cfc22 00000004:00100000:1.0:1787383400.633505:0:14180:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383400.633537:0:14180:0:(import.c:65:import_set_state_nolock()) ffff9ffc3dc70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383400.633593:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874206979617280:12345-0@lo:38:llog_process_th.0 Request processed in 316us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.633601:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383400.633617:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617408 00000100:00100000:1.0:1787383400.633620:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617408 00000100:00100000:1.0:1787383400.633641:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383400.633646:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979617408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383400.633681:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979617408:12345-0@lo:400:kworker.0 Request processed in 35us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383400.633688:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383400.633733:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc37fb6d80 x1874206979617408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383400.633747:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979617408:0@lo:400:kworker.0 00010000:00080000:2.0:1787383400.633969:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffc37fb4e00 x1874206979617280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383400.633978:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383400.633985:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787383400.633991:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787383400.633996:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787383400.633998:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc2aed8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383400.634003:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1874206979617280:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787383400.637952:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787383400.638053:0:14812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787383400.638079:0:14812:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383400.639517:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc0d expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.639535:0:14812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047c00/0x42020b050d5cfc06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc0d expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787383400.639594:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787383400.639596:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383400.639598:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383400.639599:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383400.639601:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383400.639602:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383400.639604:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383400.639606:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383400.639612:0:14812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383400.639616:0:14812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787383400.639618:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383400.639619:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383400.639621:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383400.639621:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383400.639622:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383400.639623:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383400.639624:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383400.639625:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383400.639626:0:14812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383400.639649:0:14812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787383400.639670:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787383400.639756:0:14812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.639799:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383400.639890:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617536 00000100:00100000:1.0:1787383400.639899:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617536 00000100:00100000:1.0:1787383400.639948:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383400.639958:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14812:x1874206979617536:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787383400.639986:0:14174:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787383400.640000:0:14174:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787383400.672647:0:14174:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787383400.672692:0:14174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787383400.677267:0:14196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383400.677285:0:14196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383400.677740:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.677762:0:14196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.677770:0:14196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.677811:0:14196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.677825:0:14196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 16 pid: 14175 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383400.677840:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029afb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979617664:0@lo:104: 00000100:00100000:0.0:1787383400.677936:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383400.678018:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383400.678135:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617664 00000100:00100000:2.0:1787383400.678144:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617664 00000100:00100000:2.0:1787383400.678198:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383400.678209:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979617664:12345-0@lo:104: 00010000:00010000:2.0:1787383400.678376:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383400.678632:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383400.678640:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979617664:12345-0@lo:104: Request processed in 433us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383400.678648:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787383400.678722:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383400.678730:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.678739:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519da00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:3.0:1787383400.678743:0:14169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.678752:0:14169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383400.678759:0:14169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383400.678765:0:14169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383400.678803:0:14169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.678824:0:14169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383400.678978:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.678986:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc3519da00/0x42020b050d5cfb8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfb96 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679002:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383400.679003:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383400.679005:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383400.679022:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979617792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383400.679054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383400.679099:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617792 00000100:00100000:3.0:1787383400.679104:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617792 00010000:00010000:3.0:1787383400.679125:0:14167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 17 pid: 14175 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383400.679146:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383400.679153:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:3312:x1874206979617792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383400.679162:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383400.679167:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 17 pid: 14175 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679177:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 17 pid: 14175 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679192:0:14167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679210:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383400.679483:0:14167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002198109s 00010000:00010000:3.0:1787383400.679490:0:14167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679498:0:14167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679504:0:14167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679510:0:14167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679516:0:14167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383400.679521:0:14167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679528:0:14167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679537:0:14167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383400.679548:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383400.679628:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:3312:x1874206979617792:12345-0@lo:103:ldlm_bl.0 Request processed in 475us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383400.679635:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787383400.681501:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3519d000/0x42020b050d5cfb96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfb8f expref: 16 pid: 14175 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383400.681532:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029afb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979617664:0@lo:104: 00010000:00010000:0.0:1787383400.681558:0:14196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.681568:0:14196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.681575:0:14196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383400.681582:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17046200/0x42020b050d5cfc29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383400.681661:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979617792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383400.681811:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14812:x1874206979617536:12345-0@lo:253:mount.lustre.0 Request processed in 41853us (42053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383400.681823:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383400.682022:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:14812:1874206979617536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383400.682034:0:14812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787383400.682037:0:14812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383400.682039:0:14812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383400.682040:0:14812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383400.682041:0:14812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383400.682043:0:14812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383400.682044:0:14812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383400.682045:0:14812:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383400.682047:0:14812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383400.682049:0:14812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383400.682060:0:14812:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787383400.686741:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383400.687050:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787383400.687214:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383400.687398:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787383400.687549:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383400.687781:0:14812:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787383400.689360:0:14812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787383400.747508:0:14812:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787383400.747518:0:14812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787383400.747556:0:14812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383400.747616:0:14812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383400.747633:0:14812:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787383400.747661:0:14812:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787383400.970712:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383402.000240:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787383402.186069:0:14177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383402.186078:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffb037d9000 from 7 10000000:01000000:2.0:1787383402.186083:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383402.186136:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383402.186148:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383402.186159:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383402.186187:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979617920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383402.186260:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383402.186416:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979617920 00000100:00100000:0.0:1787383402.186424:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979617920 00000100:00100000:0.0:1787383402.186484:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787383402.186494:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+15:14177:x1874206979617920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383402.186507:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383402.186521:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfc30 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383402.186556:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383402.186568:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 16 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383402.186577:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047600, rc 0) 00000100:00100000:0.0:1787383402.186616:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14177:x1874206979617920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383402.186624:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383402.186813:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383402.186837:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979617920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383402.186851:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383402.186859:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383402.186940:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979618048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383402.186971:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383402.187032:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618048 00000100:00100000:0.0:1787383402.187037:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618048 00000100:00100000:0.0:1787383402.187076:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383402.187085:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14177:x1874206979618048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787383402.187112:0:14174:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383402.187130:0:14174:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383402.187133:0:14174:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787383402.187212:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14177:x1874206979618048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383402.187221:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383402.188067:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383402.188091:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979618048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383402.188150:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383402.188157:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383402.188167:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383403.020811:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383404.042561:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383405.077221:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383405.842832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383405.842840:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383405.842843:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383405.842846:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383405.842934:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979618176:0@lo:400:kworker.0 00000100:00100000:2.0:1787383405.843007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383405.843091:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979618304:0@lo:400:kworker.0 00000100:00100000:2.0:1787383405.843125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383405.843147:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383405.843154:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979618432:0@lo:400:kworker.0 00000100:00100000:2.0:1787383405.843190:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383405.843310:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618304 00000100:00100000:2.0:1787383405.843318:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618304 00000100:00100000:2.0:1787383405.843378:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618432 00000100:00100000:2.0:1787383405.843382:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618432 00000100:00100000:2.0:1787383405.843422:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383405.843432:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979618304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383405.843444:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383405.843455:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979618432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383405.843483:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979618304:12345-0@lo:400:kworker.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383405.843493:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383405.843504:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979618432:12345-0@lo:400:kworker.0 Request processed in 51us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383405.843513:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787383405.843645:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d714a80 x1874206979618432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383405.843668:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979618432:0@lo:400:kworker.0 00010000:00080000:2.0:1787383405.843681:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc2d716680 x1874206979618304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383405.843690:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979618304:0@lo:400:kworker.0 00000100:00100000:3.0:1787383405.843756:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618176 00000100:00100000:3.0:1787383405.843760:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618176 00000100:00100000:3.0:1787383405.843795:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383405.843802:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:3313:x1874206979618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383405.843845:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:3313:x1874206979618176:12345-0@lo:400:kworker.0 Request processed in 43us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383405.843851:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787383405.843924:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979618176:0@lo:400:kworker.0 00000100:00080000:0.0:1787383405.847168:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383406.090103:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383406.884625:0:15179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787383407.121369:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383408.139050:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383409.167936:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383410.187169:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383410.634610:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787383410.955738:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383410.955746:0:12132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383410.955749:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383410.955753:0:12132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383410.955757:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979618560:0@lo:400:kworker.0 00000100:00100000:1.0:1787383410.955792:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979618688:0@lo:400:kworker.0 00000100:00100000:2.0:1787383410.955910:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979618816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383410.962065:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383410.962127:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618816 00000100:00100000:1.0:1787383410.962141:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618816 00000100:00080000:0.0:1787383410.963088:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383410.963151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383410.963318:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618688 00000100:00100000:1.0:1787383410.963326:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618688 00000100:00100000:1.0:1787383410.963354:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383410.963366:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979618816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383410.963460:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383410.963461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383410.963468:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979618688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383410.963522:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979618688:12345-0@lo:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383410.963531:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383410.963747:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618560 00000100:00100000:3.0:1787383410.963752:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618560 00000100:00100000:3.0:1787383410.963782:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383410.963788:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:3312:x1874206979618560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383410.963827:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:3312:x1874206979618560:12345-0@lo:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383410.963845:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383410.963927:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979618560:0@lo:400:kworker.0 00000100:00100000:1.0:1787383410.964031:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979618816:12345-0@lo:400:kworker.0 Request processed in 667us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383410.964038:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787383410.964096:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc3ce1d500 x1874206979618816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383410.964110:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979618816:0@lo:400:kworker.0 00010000:00080000:2.0:1787383410.964417:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc3ce1f100 x1874206979618688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383410.964428:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979618688:0@lo:400:kworker.0 00010000:00010000:1.0:1787383411.211667:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383412.250653:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787383413.255665:0:15480:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383413.255669:0:15480:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787383413.255788:0:15480:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ffc170f4000 00000020:01000004:3.0:1787383413.255804:0:15480:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787383413.255818:0:15480:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787383413.255832:0:15480:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ffc173eb380) 00000020:00000080:3.0:1787383413.255850:0:15480:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787383413.257988:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787383413.283145:0:15480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787383413.284475:0:15480:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787383413.285429:0:15480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787383413.285676:0:15480:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787383413.286067:0:15480:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787383413.286509:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 475: rc = 0 00100000:10000000:2.0:1787383413.286634:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 475: rc = 0 00100000:10000000:2.0:1787383413.286722:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 475: rc = 0 00100000:10000000:2.0:1787383413.287125:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1787383413.287573:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1787383413.287817:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1787383413.288230:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1787383413.288459:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1787383413.288696:0:15480:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00000020:00000080:2.0:1787383413.289379:0:15480:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787383413.289393:0:15480:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787383413.289404:0:15480:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42020b050d5cfc45 00000020:01000004:2.0:1787383413.289412:0:15480:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787383413.289434:0:15480:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787383413.289437:0:15480:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787383413.289442:0:15480:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787383413.289463:0:15480:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787383413.289468:0:15480:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787383413.297503:0:15480:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787383413.297545:0:15480:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787383413.297550:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787383413.297551:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.297553:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.297554:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.297555:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.297556:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.297561:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.297563:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.297564:0:15480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383413.297567:0:15480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787383413.297569:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383413.297570:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.297571:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.297572:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.297573:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.297574:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.297575:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.297576:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.297576:0:15480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383413.297642:0:15480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787383413.297665:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979618944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383413.297734:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.297793:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383413.298116:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979618944 00000100:00100000:0.0:1787383413.298125:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979618944 00000100:00100000:0.0:1787383413.298350:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383413.298360:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:15480:x1874206979618944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383413.298391:0:14174:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787383413.298395:0:14174:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787383413.298399:0:14174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787383413.302993:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+16:15480:x1874206979618944:12345-0@lo:253:mount.lustre.0 Request processed in 4625us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.303026:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383413.303116:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979618944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787383413.303133:0:15480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787383413.303137:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383413.303138:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.303139:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.303140:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.303141:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.303143:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.303144:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.303146:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.303148:0:15480:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787383413.303224:0:15480:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffc170f4000 from lustre-OST0001 10000000:01000000:2.0:1787383413.303249:0:15480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787383413.303252:0:15480:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787383413.303260:0:15480:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffc3dc7cd40 local copy 00010000:00010000:2.0:1787383413.303272:0:15480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383413.303477:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383413.303515:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.303604:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383413.303646:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619072 00000100:00100000:3.0:1787383413.303653:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619072 00000100:00100000:3.0:1787383413.303726:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383413.303736:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:15480:x1874206979619072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383413.303962:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+16:15480:x1874206979619072:12345-0@lo:501:mount.lustre.0 Request processed in 228us (446us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383413.303970:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787383413.304016:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787383413.304028:0:15480:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787383413.304171:0:15480:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787383413.304178:0:15480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383413.304190:0:15480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c400/0x42020b050d5cfab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfabd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383413.304212:0:15480:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffc170f4000 10000000:01000000:2.0:1787383413.304217:0:15480:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787383413.304222:0:15480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787383413.304224:0:15480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383413.304229:0:15480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787383413.304233:0:15480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787383413.304253:0:15480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383413.304262:0:15480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383413.304271:0:15480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383413.304284:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383413.304309:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.304481:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.304556:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619200 00000100:00100000:1.0:1787383413.304561:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619200 00000100:00100000:1.0:1787383413.304585:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787383413.304602:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:15480:x1874206979619200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383413.304611:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383413.304624:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6b800/0x42020b050d5cfc53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfc4c expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.304646:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6b800/0x42020b050d5cfc53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfc4c expref: 17 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.304658:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6b800/0x42020b050d5cfc53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc4c expref: 17 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.304668:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b800, rc 0) 00000100:00100000:1.0:1787383413.304772:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619200:12345-0@lo:101:mount.lustre.0 Request processed in 180us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.304779:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787383413.304858:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383413.304929:0:15480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc53 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383413.304938:0:15480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfc53 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383413.305543:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787383413.306630:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383413.306978:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787383413.307022:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787383413.307055:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787383413.307103:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787383413.307141:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787383413.307307:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787383413.307376:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787383413.307384:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787383413.307470:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383413.307526:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.307621:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383413.307662:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619328 00000100:00100000:3.0:1787383413.307669:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619328 00000100:00100000:3.0:1787383413.307759:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787383413.307768:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383413.308369:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619328:12345-0@lo:501:mount.lustre.0 Request processed in 600us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383413.308379:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383413.308436:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383413.308469:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383413.308506:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.308653:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.308711:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619456 00000100:00100000:1.0:1787383413.308716:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619456 00000100:00100000:1.0:1787383413.308739:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383413.308747:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383413.309041:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619456:12345-0@lo:503:mount.lustre.0 Request processed in 294us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.309049:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383413.309155:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787383413.309745:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383413.309813:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383413.309855:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.309904:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.310028:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619584 00000100:00100000:1.0:1787383413.310039:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619584 00000100:00100000:1.0:1787383413.310063:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383413.310071:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383413.310257:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619584:12345-0@lo:502:mount.lustre.0 Request processed in 186us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.310266:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383413.310476:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383413.310714:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787383413.310761:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787383413.310792:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787383413.310835:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787383413.310906:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787383413.310943:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787383413.311003:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787383413.311042:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787383413.311091:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787383413.311120:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383413.311178:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.311202:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.311309:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619712 00000100:00100000:1.0:1787383413.311314:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619712 00000100:00100000:1.0:1787383413.311338:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383413.311346:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383413.311486:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619712:12345-0@lo:502:mount.lustre.0 Request processed in 140us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.311494:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787383413.311696:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383413.311756:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787383413.311766:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787383413.312812:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787383413.312822:0:15481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787383413.312828:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383413.312837:0:15481:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787383413.312843:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383413.312858:0:15481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ffc173e8000) 00000020:00000080:3.0:1787383413.312973:0:15481:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787383413.313045:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383413.313129:0:15481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc170f4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787383413.313137:0:15481:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383413.313145:0:15481:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42020b050d5cfc61 00010000:00010000:2.0:1787383413.316895:0:15481:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787383413.317453:0:15481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787383413.319149:0:15481:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787383413.320561:0:15481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787383413.320573:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383413.320579:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383413.320581:0:15481:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787383413.320605:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383413.320609:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383413.320611:0:15481:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383413.320614:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383413.320616:0:15481:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383413.320619:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383413.320622:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383413.320623:0:15481:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787383413.320626:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383413.320629:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383413.320630:0:15481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787383413.320633:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787383413.320685:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383413.320688:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383413.320689:0:15481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787383413.320692:0:15481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787383413.320864:0:15480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787383413.320914:0:15480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787383413.320931:0:15480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc53 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.320943:0:15480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc3519c800/0x42020b050d5cfc4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc53 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383413.320957:0:15480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc170f4000 from 1 10000000:01000000:0.0:1787383413.320961:0:15480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383413.320994:0:15480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.321003:0:15480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.321015:0:15480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383413.321039:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383413.321099:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.321134:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc1e22d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.321226:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619840 00000100:00100000:1.0:1787383413.321234:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619840 00000100:00100000:1.0:1787383413.321279:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383413.321288:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:15480:x1874206979619840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383413.321301:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383413.321314:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfc68 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.321337:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.321348:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.321358:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6b600, rc 0) 00000100:00100000:1.0:1787383413.321398:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979619840:12345-0@lo:101:mount.lustre.0 Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.321405:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383413.321553:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383413.321567:0:15480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.321577:0:15480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383413.322088:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787383413.322675:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383413.322928:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787383413.322970:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787383413.323032:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787383413.323041:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787383413.323107:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383413.323323:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.323355:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc1e22d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.323563:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979619968 00000100:00100000:1.0:1787383413.323570:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979619968 00000100:00100000:1.0:1787383413.323688:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383413.323698:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979619968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383413.323918:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979619968:12345-0@lo:501:mount.lustre.0 Request processed in 222us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.323927:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383413.326223:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979619968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383413.326286:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383413.326346:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.326996:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc1e22d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383413.327072:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620096 00000100:00100000:2.0:1787383413.327079:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620096 00000100:00100000:2.0:1787383413.327123:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383413.327131:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383413.327641:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620096:12345-0@lo:503:mount.lustre.0 Request processed in 508us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383413.327651:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383413.327728:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383413.328294:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383413.328370:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383413.328418:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.328439:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc1e22d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383413.328583:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620224 00000100:00100000:2.0:1787383413.328598:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620224 00000100:00100000:2.0:1787383413.328624:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383413.328632:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383413.328802:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620224:12345-0@lo:502:mount.lustre.0 Request processed in 170us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383413.328810:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383413.328903:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383413.329155:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787383413.329580:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787383413.329644:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787383413.329678:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787383413.329709:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787383413.329753:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787383413.329786:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787383413.329815:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787383413.329847:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383413.331430:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.332284:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc1e22d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383413.332560:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620352 00000100:00100000:3.0:1787383413.332570:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620352 00000100:00100000:1.0:1787383413.339148:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787383413.339391:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383413.339691:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620352:12345-0@lo:502:mount.lustre.0 Request processed in 530us (8265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.339701:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383413.339895:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383413.340048:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787383413.340072:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787383413.341780:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383413.341793:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341796:0:15485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383413.341803:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc170f4000 00000020:00000080:0.0:1787383413.341805:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383413.341812:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383413.341815:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341816:0:15485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383413.341819:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383413.341821:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341822:0:15485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383413.341826:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffc170f4000 00000020:00000080:0.0:1787383413.341828:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383413.341903:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383413.341907:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341908:0:15485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383413.341911:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383413.341914:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341915:0:15485:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383413.341919:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffc170f4000 00000020:00000080:0.0:1787383413.341921:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383413.341955:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383413.341958:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383413.341960:0:15485:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787383413.341963:0:15485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787383413.342010:0:15480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787383413.342032:0:15480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383413.342054:0:15480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.342065:0:15480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383413.342113:0:15480:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383413.342116:0:15480:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffc170f4000 10000000:01000000:0.0:1787383413.342119:0:15480:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffc170f4000 10000000:01000000:0.0:1787383413.342122:0:15480:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383413.342127:0:15480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ffc170f4000 from 1 10000000:01000000:0.0:1787383413.342130:0:15480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383413.347750:0:15480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.347770:0:15480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.347786:0:15480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383413.347814:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383413.347895:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.347932:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.349293:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620480 00000100:00100000:1.0:1787383413.349305:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620480 00000100:00100000:1.0:1787383413.349356:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383413.349365:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979620480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383413.349380:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383413.349398:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cfc7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfc76 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.349425:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cfc7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfc76 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.349436:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3dc6a600/0x42020b050d5cfc7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc76 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.349452:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3dc6a600, rc 0) 00000100:00100000:1.0:1787383413.349515:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620480:12345-0@lo:101:mount.lustre.0 Request processed in 151us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.349522:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383413.351545:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383413.351574:0:15480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc7d expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.351587:0:15480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfc7d expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383413.352230:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787383413.352538:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383413.352777:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787383413.352837:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787383413.352915:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787383413.352963:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787383413.352999:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787383413.353043:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787383413.353075:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787383413.353105:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787383413.353150:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787383413.353182:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787383413.353212:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787383413.353253:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787383413.353286:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787383413.353316:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787383413.353359:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787383413.353390:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787383413.353420:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787383413.353466:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787383413.353520:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787383413.353555:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787383413.353627:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787383413.353666:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787383413.353699:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787383413.353745:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787383413.353777:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787383413.353807:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787383413.353850:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787383413.353911:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787383413.353942:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787383413.353989:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787383413.354025:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787383413.354058:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787383413.354091:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787383413.354137:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787383413.354190:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787383413.354238:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787383413.354271:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787383413.354352:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787383413.354360:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787383413.354458:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383413.354524:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.354563:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.355741:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620608 00000100:00100000:1.0:1787383413.355752:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620608 00000100:00100000:1.0:1787383413.355810:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383413.355820:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383413.356113:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620608:12345-0@lo:501:mount.lustre.0 Request processed in 294us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.356121:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383413.357897:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383413.357954:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383413.358017:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.358057:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383413.358121:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620736 00000100:00100000:3.0:1787383413.358128:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620736 00000100:00100000:3.0:1787383413.358397:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383413.358408:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383413.358695:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620736:12345-0@lo:503:mount.lustre.0 Request processed in 289us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383413.358703:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383413.358839:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383413.360335:0:15480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383413.360420:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383413.361287:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.361337:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.361544:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620864 00000100:00100000:1.0:1787383413.361551:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620864 00000100:00100000:1.0:1787383413.364769:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383413.364787:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383413.365179:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620864:12345-0@lo:502:mount.lustre.0 Request processed in 396us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.365188:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383413.366992:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383413.367327:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787383413.367385:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787383413.367415:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787383413.367460:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787383413.367497:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787383413.367543:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787383413.367578:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787383413.367627:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787383413.367676:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787383413.367713:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787383413.367747:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787383413.367793:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787383413.367828:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787383413.367864:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787383413.367943:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787383413.367980:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787383413.368015:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787383413.368077:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787383413.368113:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787383413.368149:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787383413.368196:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787383413.368235:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787383413.368267:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787383413.368310:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787383413.368345:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787383413.368379:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787383413.368427:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787383413.368462:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787383413.368497:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787383413.368546:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787383413.368578:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787383413.368624:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787383413.368656:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787383413.368700:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787383413.368733:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787383413.368801:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787383413.368837:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787383413.368894:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787383413.368943:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787383413.368979:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787383413.369027:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383413.369106:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383413.369156:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08ea0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383413.371608:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979620992 00000100:00100000:3.0:1787383413.371625:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979620992 00000100:00100000:3.0:1787383413.371683:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787383413.371693:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383413.371990:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979620992:12345-0@lo:502:mount.lustre.0 Request processed in 298us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383413.372004:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787383413.372084:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979620992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383413.372649:0:15480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787383413.372667:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787383413.383090:0:15490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787383413.383168:0:15490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ffc1709b380) 00000020:00000080:1.0:1787383413.383192:0:15490:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787383413.383364:0:15490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffc170f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383413.383369:0:15490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffc170f4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383413.383372:0:15490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffc170f4000 3 00010000:00080000:1.0:1787383413.383402:0:15490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc3d02c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1787383413.392400:0:15490:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787383413.392507:0:15490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787383413.392551:0:15490:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787383413.392565:0:15490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x42020b050d5cfc8b 00000100:00080000:1.0:1787383413.392575:0:15490:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383413.392580:0:15490:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ffc3d02c000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1787383413.392625:0:15490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc3ce1df80 x1874206979621120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383413.392660:0:15490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787383413.392706:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979621120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383413.392781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383413.392802:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621120 00000100:00100000:1.0:1787383413.392809:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621120 00000100:00100000:1.0:1787383413.392838:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383413.392846:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1874206979621120:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787383413.392856:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383413.392861:0:12132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383413.392865:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00080000:1.0:1787383413.392893:0:14181:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787383413.392934:0:14181:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42020b050d5cfc92 00000100:00080000:0.0:1787383413.393088:0:12132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383413.393142:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00100000:1.0:1787383413.396218:0:14181:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383413.396275:0:14181:0:(import.c:65:import_set_state_nolock()) ffff9ffc3d02c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383413.396375:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874206979621120:12345-0@lo:38:llog_process_th.0 Request processed in 3525us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.396385:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787383413.397147:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffc3ce1df80 x1874206979621120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383413.397226:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383413.397237:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787383413.397245:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383413.397250:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383413.397253:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3d02c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383413.397259:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1874206979621120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383413.397291:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979621376:0@lo:400:kworker.0 00000100:00100000:3.0:1787383413.397332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383413.397400:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979621248:0@lo:400:kworker.0 00000100:00100000:3.0:1787383413.397429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383413.397456:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621376 00000100:00100000:3.0:1787383413.398047:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621376 00000100:00100000:3.0:1787383413.398103:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621248 00000100:00100000:3.0:1787383413.398107:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621248 00000100:00100000:3.0:1787383413.398129:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383413.398139:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979621376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383413.398269:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979621376:12345-0@lo:400:kworker.0 Request processed in 131us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383413.398276:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383413.398290:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383413.398296:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979621248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383413.398323:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979621248:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383413.398328:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787383413.398345:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383413.398368:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffb029adf80 x1874206979621376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383413.398379:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979621376:0@lo:400:kworker.0 00010000:00080000:3.0:1787383413.398411:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffb029afb80 x1874206979621248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383413.398421:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979621248:0@lo:400:kworker.0 00000040:00080000:3.0:1787383413.400803:0:15490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787383413.403067:0:15480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787383413.403119:0:15480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383413.403252:0:15480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc7d expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383413.403266:0:15480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047e00/0x42020b050d5cfc76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfc7d expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383413.403327:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383413.403329:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.403330:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.403332:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.403333:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.403334:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.403336:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.403337:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.403339:0:15480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383413.403342:0:15480:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787383413.403345:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383413.403346:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.403347:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.403348:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.403349:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.403350:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.403351:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.403352:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.403353:0:15480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383413.403380:0:15480:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787383413.403403:0:15480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979621504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383413.403490:0:15480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383413.403531:0:15480:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc09c0a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383413.403645:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621504 00000100:00100000:0.0:1787383413.403653:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621504 00000100:00100000:0.0:1787383413.403704:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787383413.403714:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:15480:x1874206979621504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383413.403748:0:14174:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787383413.403761:0:14174:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787383413.466564:0:14174:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383413.466585:0:14174:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787383413.466696:0:14196:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383413.466701:0:14196:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383413.466721:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.466739:0:14196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.466749:0:14196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.466788:0:14196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.466803:0:14196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 19 pid: 14175 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383413.466817:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979621632:0@lo:104: 00000100:00100000:0.0:1787383413.466921:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.466970:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3e5b8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383413.467031:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621632 00000100:00100000:1.0:1787383413.467039:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621632 00000100:00100000:1.0:1787383413.467101:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383413.467110:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979621632:12345-0@lo:104: 00010000:00010000:1.0:1787383413.467124:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383413.467199:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383413.467205:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:14196:x1874206979621632:12345-0@lo:104: Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.467212:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787383413.467275:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383413.467281:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467289:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383413.467292:0:14169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467301:0:14169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383413.467315:0:14169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383413.467320:0:14169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383413.467347:0:14169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467354:0:14169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383413.467373:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467381:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc3519d800/0x42020b050d5cfc30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc37 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467396:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383413.467398:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383413.467399:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383413.467410:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979621760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383413.467436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383413.467579:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621760 00000100:00100000:0.0:1787383413.467583:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621760 00010000:00010000:0.0:1787383413.467613:0:14167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 20 pid: 14175 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383413.467640:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383413.467647:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb4211d2-6362-43cb-a936-032e5733e3e9+20:3313:x1874206979621760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383413.467658:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383413.467662:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 20 pid: 14175 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467679:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 20 pid: 14175 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467694:0:14167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467703:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383413.467716:0:14167:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002198109s 00010000:00010000:0.0:1787383413.467720:0:14167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467728:0:14167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467735:0:14167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467741:0:14167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467746:0:14167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383413.467750:0:14167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467757:0:14167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467765:0:14167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467785:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383413.467814:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb4211d2-6362-43cb-a936-032e5733e3e9+20:3313:x1874206979621760:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383413.467820:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383413.467855:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979621760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383413.467916:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047600/0x42020b050d5cfc37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfc30 expref: 19 pid: 14175 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383413.467925:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14196:1874206979621632:0@lo:104: 00010000:00010000:0.0:1787383413.467936:0:14196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467943:0:14196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467949:0:14196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383413.467955:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc17047200/0x42020b050d5cfc99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383413.489911:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:15480:x1874206979621504:12345-0@lo:253:mount.lustre.0 Request processed in 86186us (86408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383413.489928:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383413.490059:0:15480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb4211d2-6362-43cb-a936-032e5733e3e9:15480:1874206979621504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787383413.490079:0:15480:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787383413.490083:0:15480:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383413.490231:0:15480:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383413.490233:0:15480:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383413.490234:0:15480:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383413.490235:0:15480:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383413.490237:0:15480:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383413.490239:0:15480:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383413.490240:0:15480:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383413.490242:0:15480:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787383413.490257:0:15480:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787383413.501561:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787383413.501765:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787383413.502342:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383413.502810:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787383413.504358:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787383413.504722:0:15480:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787383413.505679:0:15480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787383413.623219:0:15480:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787383413.623230:0:15480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787383413.623266:0:15480:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383413.623337:0:15480:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383413.623351:0:15480:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787383413.623380:0:15480:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787383414.282052:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383414.410060:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383398/real 1787383398] req@ffff9ffb029aed80 x1874206979614720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383414.410103:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffb029aed80 x1874206979614720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383414.410114:0:3311:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383398/real 1787383398] req@ffff9ffb029aca80 x1874206979614848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383414.410136:0:3311:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffb029aca80 x1874206979614848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383414.410341:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3c82b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383414.410363:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787383414.410368:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979614720:0@lo:8:kworker.0 00000100:00080000:3.0:1787383414.410373:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc349c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383414.410378:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787383414.410381:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979614848:0@lo:8:kworker.0 00000100:00080000:1.0:1787383414.410523:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383414.410528:0:12132:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787383414.410530:0:12132:0:(import.c:65:import_set_state_nolock()) ffff9ffc3c82b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383414.410662:0:12132:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:1.0:1787383414.410668:0:12132:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787383414.410674:0:12132:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffc3c82b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1787383414.410697:0:12132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc3ce1ca80 x1874206979622016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383414.410713:0:12132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383414.410716:0:12132:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787383414.410717:0:12132:0:(import.c:65:import_set_state_nolock()) ffff9ffc349c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383414.410720:0:12132:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:1.0:1787383414.410722:0:12132:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787383414.410726:0:12132:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffc349c2000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1787383414.410738:0:12132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc3ce1d880 x1874206979622144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383414.410859:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979622272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.411065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383414.411299:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383414.411307:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979621888:0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.411338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383414.411370:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979622400:0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.411398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383414.411414:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383414.411420:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979622528:0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.411445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383414.411574:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622272 00000100:00100000:3.0:1787383414.411592:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622272 00000100:00100000:3.0:1787383414.411635:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622400 00000100:00100000:3.0:1787383414.411638:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622400 00000100:00100000:3.0:1787383414.411651:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622528 00000100:00100000:3.0:1787383414.411654:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622528 00000100:00100000:3.0:1787383414.411678:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383414.411687:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383414.411742:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979622272:12345-0@lo:400:kworker.0 Request processed in 56us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383414.411748:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383414.411763:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383414.411769:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979622400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383414.411795:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979622400:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383414.411800:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383414.411810:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383414.411828:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979622528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383414.411856:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979622528:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383414.411861:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383414.411906:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979621888 00000100:00100000:3.0:1787383414.411910:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979621888 00000100:00100000:3.0:1787383414.411935:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787383414.412417:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1e680 x1874206979622528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383414.412430:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979622528:0@lo:400:kworker.0 00010000:00080000:0.0:1787383414.412450:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1dc00 x1874206979622400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383414.412527:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3d0ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+18:3315:x1874206979621888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.412634:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979622400:0@lo:400:kworker.0 00000100:00100000:3.0:1787383414.412729:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3d0ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+18:3315:x1874206979621888:12345-0@lo:400:kworker.0 Request processed in 207us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383414.412737:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787383414.412780:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383414.412797:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979622016:0@lo:8:kworker.0 00000100:00100000:3.0:1787383414.412844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383414.413729:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979622144:0@lo:8:kworker.0 00000100:00100000:3.0:1787383414.413767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383414.424324:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979621888:0@lo:400:kworker.0 00010000:00080000:3.0:1787383414.424347:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1c380 x1874206979622272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383414.424361:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979622272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383414.433331:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622016 00000100:00100000:0.0:1787383414.433349:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622016 00000100:00100000:0.0:1787383414.433396:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622144 00000100:00100000:0.0:1787383414.433400:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622144 00000100:00100000:0.0:1787383414.433419:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383414.433427:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1874206979622016:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787383414.434047:0:14814:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:0.0:1787383414.434089:0:14814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cfca0 00002000:00100000:0.0:1787383414.434117:0:14814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ffc050de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787383414.434122:0:14814:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787383414.434125:0:14814:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787383414.434780:0:14814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787383414.434815:0:14814:0:(import.c:65:import_set_state_nolock()) ffff9ffc050db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383414.435346:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874206979622016:12345-0@lo:8:kworker.0 Request processed in 1917us (22498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383414.435356:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383414.435387:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383414.435393:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1874206979622144:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787383414.435417:0:14814:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:0.0:1787383414.435443:0:14814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42020b050d5cfca7 00002000:00100000:0.0:1787383414.436301:0:14814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ffc050dc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787383414.436307:0:14814:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787383414.436310:0:14814:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787383414.442752:0:14814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787383414.442791:0:14814:0:(import.c:65:import_set_state_nolock()) ffff9ffc050db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383414.442921:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874206979622144:12345-0@lo:8:kworker.0 Request processed in 7525us (29152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383414.442934:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383414.453259:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1ca80 x1874206979622016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383414.453284:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383414.453294:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787383414.453304:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787383414.453310:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787383414.453314:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc3c82b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787383414.453342:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787383414.453348:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979622016:0@lo:8:kworker.0 00010000:00080000:1.0:1787383414.453365:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1d880 x1874206979622144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383414.453374:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383414.453378:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787383414.453383:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787383414.453386:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787383414.453388:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ffc349c2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787383414.453401:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787383414.453405:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1874206979622144:0@lo:8:kworker.0 00000004:00080000:0.0:1787383414.453552:0:14202:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383414.454083:0:14202:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438668213411ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787383414.454111:0:14204:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383414.454721:0:14204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438668850856ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787383414.455365:0:14205:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787383414.455396:0:14205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14205:1874206979622784:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787383414.456566:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383414.456618:0:14205:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2747f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383414.456638:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979622656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383414.456673:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383414.456733:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622784 00000100:00100000:1.0:1787383414.456741:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622784 00000100:00100000:1.0:1787383414.456793:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383414.456811:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14205:x1874206979622784:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787383414.457428:0:14203:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787383414.457448:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14203:1874206979623040:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787383414.457497:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383414.457517:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383414.457591:0:14815:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383414.457599:0:14815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1787383414.457613:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383414.457631:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622656 00000100:00100000:2.0:1787383414.457636:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622656 00000100:00100000:2.0:1787383414.457665:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383414.457673:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979622656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383414.457687:0:14817:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383414.457723:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874206979622656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383414.457730:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383414.459087:0:14814:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383414.459101:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623040 00000100:00100000:2.0:1787383414.459108:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623040 00000100:00080000:2.0:1787383414.459129:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383414.466330:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979622912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383414.466406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787383414.466901:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc3ce1d880 x1874206979622656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383414.466926:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979622656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383414.466968:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979622912 00000100:00100000:1.0:1787383414.466973:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979622912 00000100:00100000:1.0:1787383414.467004:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383414.467011:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874206979622912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383414.467048:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383414.467105:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1874206979622912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383414.467112:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383414.467889:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383414.467901:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14203:x1874206979623040:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1787383414.470983:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb4700 x1874206979622912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383414.471011:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979622912:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787383414.488233:0:14816:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787383414.488242:0:14816:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787383414.488246:0:14816:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00080000:3.0:1787383414.491802:0:15532:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787383414.491812:0:15532:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787383414.491818:0:15532:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1787383414.500895:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.500908:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.500924:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.500934:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.500940:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.500957:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.500967:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.500975:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.510418:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383414.511024:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.511036:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.511054:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.511059:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.511065:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.511081:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.511103:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.511117:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.515768:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383414.515790:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.515802:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.515806:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.515815:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.515835:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.515840:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.516028:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383414.516031:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.516036:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ba00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.516038:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.516043:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.516057:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.516062:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.516063:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.516065:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.520920:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.520930:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.520947:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.520951:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.520955:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.520967:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.520974:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.520979:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.520995:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.521005:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.521009:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.521014:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.521017:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.521023:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.521043:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.521048:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.521059:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.521060:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.521061:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.522567:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787383414.522587:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.522635:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.524073:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1787383414.525295:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.525305:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525323:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.525328:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.525334:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525348:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525358:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525366:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525402:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.525415:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.525421:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525428:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.525433:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.525443:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526311:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526327:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.526331:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.526337:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526348:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526357:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526364:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.526395:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.526551:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526559:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfcca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526587:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.526592:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526599:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.526603:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526622:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526637:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526643:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfcc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.526658:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.526660:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.526661:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.526671:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.528988:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.529000:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.529014:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.529019:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.529025:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.529036:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.529044:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.529052:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.529069:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383414.529750:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.529759:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529769:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.529772:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.529776:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529786:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529793:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529806:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529820:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383414.529834:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383414.529840:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529847:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.529852:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529860:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529892:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529900:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfcd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529916:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.529920:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529939:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ba00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.529941:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529949:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529959:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529965:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfcd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.529977:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.529979:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.529981:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.530268:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.533743:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.533757:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533774:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.533779:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.533785:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533799:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533817:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533824:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533842:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.533854:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.533859:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533880:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.533884:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533893:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533909:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533916:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfcdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.533932:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.533939:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.533940:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.534599:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.534609:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534620:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.534631:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.534636:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534645:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534653:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534660:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534677:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.534686:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.534691:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534698:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.534702:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534710:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534721:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534738:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfce6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.534753:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.534755:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.534757:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.535245:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.535251:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.535261:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.535264:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.535269:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.535279:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.535287:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.535294:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.535316:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383414.540047:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.540067:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540098:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.540103:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.540109:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540125:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540136:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540145:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540172:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383414.540188:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383414.540194:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540202:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.540207:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540217:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540243:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540250:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf83643/0x42020b050d5cfced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540270:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.540274:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540281:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98e00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.540284:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540291:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540300:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540307:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f36212/0x42020b050d5cfcf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540318:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.540320:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.540326:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.540786:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.540793:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540801:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.540804:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.540808:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540816:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540824:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540831:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540847:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.540855:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.540858:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540865:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.540895:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540912:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540923:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540929:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d90d90/0x42020b050d5cfcfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.540942:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.540944:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.540945:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.541311:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.541317:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541326:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.541329:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.541333:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541341:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541348:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541361:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541377:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.541385:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.541389:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541395:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.541398:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541405:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541415:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541421:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfd02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.541433:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.541435:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.541437:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.541975:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.542374:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.542382:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542393:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.542396:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.542401:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542411:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542421:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542428:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542458:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.542466:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.542470:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542477:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.542481:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542495:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542507:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542514:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542528:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.542529:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.542531:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.542942:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.542948:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542956:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.542959:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.542963:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542971:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542979:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.542993:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543007:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.543016:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.543020:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543028:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.543031:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543039:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543050:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543056:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe76858/0x42020b050d5cfd10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543069:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.543071:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.543073:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.543450:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.543461:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543469:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.543472:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.543477:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543486:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543493:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543500:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543513:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.543520:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.543524:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543531:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6aa00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.543534:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543541:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543558:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543564:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe1abab/0x42020b050d5cfd17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.543577:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.543592:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.543594:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.543990:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.543995:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544003:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.544006:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.544010:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544018:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544025:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544030:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544053:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.544061:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.544065:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544071:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6bc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.544075:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544082:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544092:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544099:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b06cb3/0x42020b050d5cfd1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544112:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.544114:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.544115:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.544509:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.544515:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544523:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.544532:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.544537:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544547:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544554:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544561:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544574:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.544614:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.544618:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544625:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.544628:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544635:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544644:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544660:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001299fe71/0x42020b050d5cfd25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.544672:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.544673:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.544674:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.545075:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.545081:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545089:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.545092:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.545097:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545105:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545112:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545119:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545134:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.545142:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.545151:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545157:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6a800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.545161:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545168:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545179:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545186:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c8a4d6/0x42020b050d5cfd2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.545200:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.545201:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.545203:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.549693:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.549714:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.549731:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.549736:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.549743:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.549757:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.549768:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.549776:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.549791:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383414.551568:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383414.551593:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.551606:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.551612:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.551623:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.551648:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.551656:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011881580/0x42020b050d5cfd33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.551682:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.551684:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.551692:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.552078:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.552086:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383414.553739:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787383414.553760:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787383414.554568:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.554573:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.554593:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.554611:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.554631:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.554640:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383414.554753:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.554761:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.554770:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.554772:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.554776:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.554797:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.554806:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.554813:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.556641:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787383414.557295:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.557305:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.557322:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.557326:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.557333:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.557347:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.557358:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.557367:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560200:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787383414.560214:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560227:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.560232:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560244:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560265:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560272:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5cfd3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560295:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383414.560300:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560307:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ae00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.560310:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560328:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560339:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560346:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383414.560349:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560356:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.560359:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560366:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560375:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.560381:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.560382:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.560385:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.561405:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787383414.561416:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b2557ad/0x42020b050d5cfd41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383414.562123:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.562131:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562143:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.562388:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.562396:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562410:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562431:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562493:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562520:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.562534:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.562540:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562549:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6be00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.562554:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562563:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562589:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562597:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f4cc38/0x42020b050d5cfd4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.562614:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.562622:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.562624:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.564359:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.564419:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.564430:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.564517:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.564522:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.564529:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.564543:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.564553:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.564561:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.564624:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383414.565764:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.565776:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565791:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.565795:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.565801:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565820:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565831:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565839:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565865:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383414.565897:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383414.565903:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565911:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6b000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.565916:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565925:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565940:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565949:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb4fd83/0x42020b050d5cfd56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565974:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.565977:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565984:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3dc6ba00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.565987:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.565994:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.566004:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.566011:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e805f21/0x42020b050d5cfd5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.566021:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.566023:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.566025:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.566210:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787383414.566218:0:15532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997e4451/0x42020b050d5cfd48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383414.567038:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.567047:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567059:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.567062:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.567067:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567077:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567099:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567107:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567117:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383414.567777:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.567785:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567800:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.567803:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.567807:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567816:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567824:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567830:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.567838:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383414.568321:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383414.568329:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568339:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.568350:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568359:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568378:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568385:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5cfd64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568405:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.568408:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568414:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.568417:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568425:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568431:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.568437:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5a1618/0x42020b050d5cfd6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383414.570849:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.570864:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.570897:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.570902:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.570907:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.570920:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.570943:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.570950:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.570961:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.572209:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.572215:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.572226:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.572231:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.572241:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.572259:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.572267:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e9a6c6a/0x42020b050d5cfd72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.572279:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.572280:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.572282:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.573572:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.573590:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573605:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.573616:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.573622:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573634:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573643:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573650:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573667:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.573680:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.573685:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573692:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aadc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.573696:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573703:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573718:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573734:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68b4cb5/0x42020b050d5cfd79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.573751:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.573753:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.573754:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.574980:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.574990:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575003:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.575007:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.575012:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575022:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575032:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575039:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575060:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.575074:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.575099:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575109:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.575114:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575122:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.575138:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.576097:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.576845:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.576857:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.576902:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.576906:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.576912:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.576926:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.576936:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.576943:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.576984:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.579106:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08029bb/0x42020b050d5cfd80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579696:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.579705:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579716:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662e00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.579722:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579732:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579776:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579783:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab537ede/0x42020b050d5cfd87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.579801:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.579803:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.579806:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.580494:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.581044:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.581053:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.581067:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.581071:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.581077:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383414.581819:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.581827:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.581838:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.581841:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.581846:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.581860:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.581899:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.581908:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.581932:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383414.583024:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.583036:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583047:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.583058:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.583063:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583073:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583080:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583318:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383414.583326:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583335:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383414.583340:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583350:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583366:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583374:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7abb417/0x42020b050d5cfd95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.583394:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.583396:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.583398:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.583661:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583680:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.583692:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.583697:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583704:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.583707:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583714:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583724:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583743:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd33e7b6/0x42020b050d5cfd9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.583757:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.583759:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.583761:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.584749:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584763:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584771:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584819:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.584832:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.584837:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584845:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.584849:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584857:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584892:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584901:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20f2e18/0x42020b050d5cfd8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.584924:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.584926:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.584928:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.585666:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.585674:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.585684:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.585694:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.585700:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.585711:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.585719:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.585726:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.585749:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383414.586208:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.586214:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586222:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.586225:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.586229:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586239:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586246:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586258:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586273:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383414.586285:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383414.586290:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586297:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.586301:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586310:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586324:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586331:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd02ec40/0x42020b050d5cfda3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586348:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.586352:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586369:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aacc00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.586372:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586380:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586389:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586395:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007753cb07/0x42020b050d5cfdaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586407:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.586408:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.586410:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.586816:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.586823:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586831:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.586834:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.586838:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586847:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586861:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586893:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586908:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.586915:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.586919:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586925:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aada00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.586928:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586936:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586947:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586954:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3be068e/0x42020b050d5cfdb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.586968:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.586975:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.586977:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.587387:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.587393:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587401:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.587404:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.587409:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587419:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587427:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587434:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587449:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.587458:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.587461:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587469:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aaca00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.587472:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587494:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587506:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587514:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003316707d/0x42020b050d5cfdb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587529:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.587531:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.587533:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.587962:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.587969:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587977:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.587980:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.587984:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.587992:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588000:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588017:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588029:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.588037:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.588040:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588048:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aace00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.588051:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588059:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588070:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588077:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001557761e/0x42020b050d5cfdbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588090:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.588091:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.588093:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.588474:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.588488:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588497:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.588501:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.588505:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588514:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588523:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588531:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588545:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383414.588554:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.588558:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588564:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aad000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.588568:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.588575:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.588648:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383414.589255:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.589263:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589271:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.589274:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.589279:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589287:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589295:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589302:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589317:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.589332:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787383414.589826:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.589832:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589841:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.589844:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.589848:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589856:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.589862:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.590063:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.590073:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383414.590957:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.590966:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.590977:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.590980:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.590985:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591006:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591014:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591021:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591029:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787383414.591770:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.591778:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591787:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.591790:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.591794:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591803:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591810:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591827:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.591836:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787383414.592059:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592068:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b3db3ea/0x42020b050d5cfdc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592213:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787383414.592219:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592227:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01663800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.592232:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592240:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592251:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592259:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6179c87/0x42020b050d5cfdd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592272:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383414.592275:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592288:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01663a00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.592291:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592299:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592309:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592315:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f39564/0x42020b050d5cfddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592326:0:14168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383414.592329:0:14168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592336:0:14168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383414.592339:0:14168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592346:0:14168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592355:0:14168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592367:0:14168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035183b2b/0x42020b050d5cfde2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.592378:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.592380:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383414.592382:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383414.593640:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.593650:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.593730:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.593734:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.593740:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.593751:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.593760:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.593768:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.593789:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383414.594410:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.594415:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.594422:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.594424:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.594427:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.594433:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.594438:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.594443:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383414.594773:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.594783:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.594789:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.594791:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.594794:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.594800:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.594804:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.594809:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.594815:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383414.595215:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787383414.595698:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.595703:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.595714:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.595716:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.595720:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.595726:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.595731:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.595736:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.595740:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787383414.596024:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787383414.596028:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.596033:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787383414.596035:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383414.596038:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.596043:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.596056:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.596060:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.596064:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787383414.596251:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787383414.596255:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.596261:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1787383414.596263:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383414.596265:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.596271:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.596281:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.596285:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383414.596289:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1787383414.596742:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787383414.596754:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596760:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aad200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596763:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596770:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596784:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596788:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c61151b8/0x42020b050d5cfde9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596804:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787383414.596807:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596811:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aade00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596812:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596816:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596828:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596833:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014bab189/0x42020b050d5cfdf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596840:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787383414.596843:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596846:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01663c00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596848:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596853:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596859:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596863:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004281384/0x42020b050d5cfdf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596885:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383414.596887:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596895:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662c00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596897:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596901:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596907:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596911:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093fecc30/0x42020b050d5cfdfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596918:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383414.596920:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596924:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596925:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596930:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596934:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596941:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000166cf538/0x42020b050d5cfe05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596948:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383414.596950:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596954:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aad400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.596955:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596960:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596965:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596969:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e227f59/0x42020b050d5cfe0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.596975:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.596976:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.596978:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.596993:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597005:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc01662600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.597007:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597011:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597017:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597021:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000cf188d/0x42020b050d5cfdcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597029:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.597030:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.597031:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383414.597360:0:14816:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787383414.597367:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597376:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1787383414.597379:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383414.597384:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597394:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597408:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597415:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.597435:0:14816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.597640:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.597646:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.597655:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519ca00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.597659:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.597666:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.597680:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.597687:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade91458/0x42020b050d5cfe13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.597702:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.597709:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.597710:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787383414.597847:0:14816:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787383414.597960:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14205:x1874206979622784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 141146us (141393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383414.597970:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1787383414.598309:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787383414.598315:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.598325:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1787383414.598328:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383414.598333:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.598343:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.598351:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.598368:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.598391:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383414.598638:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.598645:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.598654:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d200 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:3.0:1787383414.598658:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.598666:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.598680:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.598687:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028d75654/0x42020b050d5cfe1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.598701:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.598703:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.598705:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.598791:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383414.598961:0:14205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14205:1874206979622784:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787383414.598976:0:14205:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787383414.599021:0:14205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14205:1874206979623168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787383414.599063:0:14205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383414.599119:0:14205:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05f1fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383414.599354:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623168 00000100:00100000:3.0:1787383414.599361:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623168 00000100:00100000:3.0:1787383414.599468:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00002000:00010000:2.0:1787383414.599471:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:3.0:1787383414.599477:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14205:x1874206979623168:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1787383414.599477:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599489:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1787383414.599492:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383414.599497:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599508:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599515:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787383414.599522:0:14814:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1787383414.599522:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599548:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383414.599958:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787383414.599964:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599977:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1787383414.599980:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383414.599985:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.599994:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.600002:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.600010:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.600023:0:15532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787383414.600178:0:15532:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787383414.600242:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14203:x1874206979623040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 132342us (142742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383414.600250:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383414.600293:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14203:1874206979623040:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787383414.600306:0:14203:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787383414.600339:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14203:1874206979623296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787383414.600369:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383414.604676:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623296 00000100:00100000:0.0:1787383414.604689:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623296 00000100:00100000:2.0:1787383414.604706:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3dc20840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383414.605297:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383414.605308:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14203:x1874206979623296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787383414.605358:0:14815:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787383414.609046:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383414.609060:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609074:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.609081:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609092:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609114:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609122:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5cfe21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609142:0:14169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383414.609145:0:14169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609152:0:14169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383414.609155:0:14169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609162:0:14169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609184:0:14169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609192:0:14169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005862aeba/0x42020b050d5cfe28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383414.609205:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.609207:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.609209:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383414.609217:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383414.613017:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14205:x1874206979623168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13535us (13947us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787383414.613036:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383414.613141:0:14205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14205:1874206979623168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787383414.613167:0:14205:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787383414.616551:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14203:x1874206979623296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11237us (16174us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787383414.616564:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383414.616699:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14203:1874206979623296:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787383414.616715:0:14203:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787383415.309056:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383415.369921:0:14177:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383415.369928:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ffb037d9000 from 8 10000000:01000000:0.0:1787383415.369932:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383415.369978:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383415.369987:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383415.369996:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383415.370019:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979623424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383415.370094:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383415.370148:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05f1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383415.370202:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623424 00000100:00100000:2.0:1787383415.370208:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623424 00000100:00100000:2.0:1787383415.370252:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383415.370258:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979623424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383415.370269:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383415.370281:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3519c600/0x42020b050d5cfe36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfe2f expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383415.370298:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519c600/0x42020b050d5cfe36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfe2f expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383415.370306:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3519c600/0x42020b050d5cfe36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfe2f expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383415.370313:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c600, rc 0) 00000100:00100000:2.0:1787383415.370347:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979623424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383415.370365:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787383415.370629:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979623424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383415.370645:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfe36 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383415.370654:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfe36 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383415.370701:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979623552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383415.370729:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383415.370763:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc05f1f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383415.370810:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623552 00000100:00100000:3.0:1787383415.370822:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623552 00000100:00100000:3.0:1787383415.370849:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383415.370854:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979623552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787383415.370895:0:14172:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787383415.370910:0:14172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787383415.370912:0:14172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787383415.370967:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979623552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383415.370972:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787383415.371454:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979623552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787383415.371511:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383415.371520:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfe36 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383415.371528:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc17047800/0x42020b050d5cfe2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfe36 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787383416.226069:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787383416.226089:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1787383416.330246:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383417.354020:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383418.383827:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787383418.843528:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787383418.843624:0:7504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1787383419.402012:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383419.658050:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979623680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383419.658132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383419.658215:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623680 00000100:00100000:1.0:1787383419.658223:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623680 00000100:00100000:1.0:1787383419.658276:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383419.658285:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979623680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383419.658319:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383419.658363:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979623680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383419.658380:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787383419.658400:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383419.658444:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787383419.658464:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979623680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383419.658736:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979623808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383419.658767:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383419.658846:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623808 00000100:00100000:3.0:1787383419.658851:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623808 00000100:00100000:3.0:1787383419.658904:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383419.658911:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979623808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383419.658932:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383419.658968:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979623808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383419.658973:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787383419.659031:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383419.659048:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787383419.659079:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979623808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383419.659726:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979624064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383419.659766:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383419.659808:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383419.659814:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979623936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383419.659844:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383419.659896:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979623936 00000100:00100000:3.0:1787383419.659901:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979623936 00000100:00100000:3.0:1787383419.659932:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383419.659940:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3315:x1874206979623936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383419.659979:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3315:x1874206979623936:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383419.659987:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383419.660029:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979623936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383419.660168:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624064 00000100:00100000:2.0:1787383419.660172:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624064 00000100:00100000:2.0:1787383419.660212:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383419.660220:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979624064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383419.660259:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979624064:12345-0@lo:400:kworker.0 Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383419.660266:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787383419.660343:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb4a80 x1874206979624064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383419.660355:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979624064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383419.660487:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979624320:0@lo:400:kworker.0 00000100:00100000:1.0:1787383419.660520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383419.660553:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383419.660560:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979624192:0@lo:400:kworker.0 00000100:00100000:1.0:1787383419.660587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383419.660663:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624320 00000100:00100000:3.0:1787383419.660667:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624320 00000100:00100000:3.0:1787383419.660702:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624192 00000100:00100000:3.0:1787383419.660705:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624192 00000100:00100000:3.0:1787383419.660722:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383419.660728:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979624320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383419.660762:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979624320:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383419.660768:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383419.660780:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383419.660786:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979624192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383419.660813:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979624192:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383419.660827:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787383419.660926:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787383419.660947:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb5180 x1874206979624192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383419.660957:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979624192:0@lo:400:kworker.0 00010000:00080000:1.0:1787383419.660969:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb7100 x1874206979624320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383419.660979:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979624320:0@lo:400:kworker.0 00010000:00010000:1.0:1787383420.430843:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383420.875751:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383421.450017:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383421.990800:0:15842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787383422.477571:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383423.498543:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383424.525057:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383424.623009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.623115:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852096 00000100:00100000:2.0:1787383424.623126:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852096 00000100:00100000:2.0:1787383424.623172:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1787383424.623181:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2347:x1874206962852096:12345-192.168.202.19@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787383424.623212:0:14175:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1015050f-5d12-4451-a0c1-63e34e492629@192.168.202.19@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1787383424.623241:0:14175:0:(genops.c:1406:class_connect()) connect: client 1015050f-5d12-4451-a0c1-63e34e492629, cookie 0x42020b050d5cfe3d 00000100:00080000:2.0:1787383424.623364:0:14175:0:(import.c:65:import_set_state_nolock()) ffff9ffc21527000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383424.623443:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+5:2347:x1874206962852096:12345-192.168.202.19@tcp:250:mount.lustre.0 Request processed in 261us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.623451:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1787383424.645400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383424.646001:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852224 00000100:00100000:3.0:1787383424.646013:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852224 00000100:00100000:3.0:1787383424.646084:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1787383424.646095:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+5:13693:x1874206962852224:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383424.646111:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383424.646131:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99200/0x42020b050d5cfe44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4c8 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.646158:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99200/0x42020b050d5cfe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4c8 expref: 6 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.646169:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99200/0x42020b050d5cfe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4c8 expref: 6 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.646178:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99200, rc 0) 00000100:00100000:3.0:1787383424.648845:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+6:13693:x1874206962852224:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 2738us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383424.648859:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1787383424.655605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383424.656935:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852352 00000100:00100000:3.0:1787383424.656948:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852352 00000100:00100000:3.0:1787383424.657013:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1787383424.657025:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+6:13693:x1874206962852352:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787383424.657435:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+6:13693:x1874206962852352:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 411us (1838us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383424.657452:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1787383424.663326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383424.666158:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852480 00000100:00100000:0.0:1787383424.666172:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852480 00000100:00100000:1.0:1787383424.666374:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:1.0:1787383424.666386:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+6:13693:x1874206962852480:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383424.666414:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383424.666434:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffb01aac200/0x42020b050d5cfe4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4cf expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.666463:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffb01aac200/0x42020b050d5cfe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4cf expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.666475:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffb01aac200/0x42020b050d5cfe4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4cf expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.666493:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aac200, rc 0) 00000100:00100000:1.0:1787383424.666564:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+7:13693:x1874206962852480:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 180us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.666571:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1787383424.674998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.675649:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852608 00000100:00100000:2.0:1787383424.675662:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852608 00000100:00100000:2.0:1787383424.675766:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1787383424.675778:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+7:13693:x1874206962852608:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787383424.676254:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+8:13693:x1874206962852608:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 477us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.676264:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1787383424.680501:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.680597:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852736 00000100:00100000:1.0:1787383424.680608:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852736 00000100:00100000:1.0:1787383424.680664:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:1.0:1787383424.680675:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+8:13693:x1874206962852736:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383424.681223:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+8:13693:x1874206962852736:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 547us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.681233:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1787383424.685629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.685906:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852864 00000100:00100000:2.0:1787383424.685925:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852864 00000100:00100000:2.0:1787383424.685991:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:2.0:1787383424.686003:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+8:13712:x1874206962852864:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383424.686402:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+8:13712:x1874206962852864:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 401us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.686411:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1787383424.716704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383424.716829:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962852992 00000100:00100000:3.0:1787383424.716840:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962852992 00000100:00100000:3.0:1787383424.716925:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:3.0:1787383424.716937:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+8:13712:x1874206962852992:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383424.717263:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+8:13712:x1874206962852992:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 327us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383424.717271:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1787383424.729737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.729847:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853120 00000100:00100000:1.0:1787383424.729858:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853120 00000100:00100000:1.0:1787383424.729958:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1787383424.729969:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+8:13693:x1874206962853120:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383424.730002:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383424.730023:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffb01aac000/0x42020b050d5cfe52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b4f9 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.730053:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffb01aac000/0x42020b050d5cfe52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4f9 expref: 9 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.730071:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffb01aac000/0x42020b050d5cfe52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b4f9 expref: 9 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383424.730081:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aac000, rc 0) 00000100:00100000:1.0:1787383424.730132:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+9:13693:x1874206962853120:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 165us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.730138:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:0.0:1787383424.746195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.756329:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853248 00000100:00100000:2.0:1787383424.756344:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853248 00000100:00100000:2.0:1787383424.756440:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:2.0:1787383424.756451:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+9:13693:x1874206962853248:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787383424.756481:0:14175:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787383424.756523:0:14175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787383424.756528:0:14175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787383424.756531:0:14175:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787383424.756534:0:14175:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787383424.760721:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+9:13693:x1874206962853248:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 4256us (14521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.760738:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1787383424.765564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383424.765788:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853376 00000100:00100000:3.0:1787383424.765799:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853376 00000100:00100000:3.0:1787383424.765862:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1787383424.765906:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+9:13693:x1874206962853376:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383424.765937:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383424.765957:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b500 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.765988:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 10 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.766000:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 10 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383424.766009:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99a00, rc 0) 00000100:00100000:3.0:1787383424.766060:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+10:13693:x1874206962853376:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 157us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383424.766086:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:0.0:1787383424.772802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.773075:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853504 00000100:00100000:2.0:1787383424.773090:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853504 00000100:00100000:2.0:1787383424.773171:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:2.0:1787383424.773182:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3fc7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+10:13693:x1874206962853504:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787383424.775528:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3fc7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+10:13693:x1874206962853504:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 2337us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.775543:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1787383424.782122:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383424.782147:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979624448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383424.782220:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383424.782292:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624448 00000100:00100000:1.0:1787383424.782300:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624448 00000100:00100000:1.0:1787383424.782358:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383424.782367:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979624448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383424.782405:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383424.782455:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979624448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.782462:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787383424.782496:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383424.782541:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979624448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383424.782821:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979624576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383424.782848:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383424.783284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.783305:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853632 00000100:00100000:1.0:1787383424.783309:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853632 00000100:00100000:1.0:1787383424.783554:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1787383424.783563:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+10:13693:x1874206962853632:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787383424.783740:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624576 00000100:00100000:3.0:1787383424.783750:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624576 00000100:00100000:3.0:1787383424.783827:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383424.783841:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979624576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383424.783929:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787383424.784128:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979624704:0@lo:400:kworker.0 00000100:00100000:3.0:1787383424.784733:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979624576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 894us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383424.784745:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787383424.784784:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383424.785039:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+10:13693:x1874206962853632:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 1471us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.785051:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1787383424.789705:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979624832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383424.789731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383424.789804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383424.790084:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979624960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383424.790135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383424.790178:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383424.790187:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979625088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383424.790216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383424.790250:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624832 00000100:00100000:2.0:1787383424.790259:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624832 00000100:00100000:2.0:1787383424.790304:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624960 00000100:00100000:2.0:1787383424.790307:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624960 00000100:00100000:2.0:1787383424.790330:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625088 00000100:00100000:2.0:1787383424.790332:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625088 00000100:00100000:2.0:1787383424.790349:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383424.790358:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383424.790859:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979624704 00000100:00100000:1.0:1787383424.790890:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979624704 00000100:00100000:1.0:1787383424.791004:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787383424.791013:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979624704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383424.791059:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979624704:12345-0@lo:400:kworker.0 Request processed in 48us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.791067:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383424.791621:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979624704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383424.791675:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383424.791693:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979624960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383424.791794:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979624960:12345-0@lo:400:kworker.0 Request processed in 110us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383424.791823:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383424.791853:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383424.791861:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383424.791899:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874206979624832:12345-0@lo:400:kworker.0 Request processed in 1537us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.791911:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383424.791926:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874206979625088:12345-0@lo:400:kworker.0 Request processed in 65us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383424.791934:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787383424.791969:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383424.792034:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979624576:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787383424.792066:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb4a80 x1874206979625088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383424.792082:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1874206979625088:0@lo:400:kworker.0 00010000:00080000:1.0:1787383424.792096:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb5180 x1874206979624960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383424.792105:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979624960:0@lo:400:kworker.0 00010000:00080000:3.0:1787383424.792680:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffc37fb7100 x1874206979624832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383424.792695:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874206979624832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383424.793103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.795159:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853760 00000100:00100000:1.0:1787383424.795191:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853760 00000100:00100000:1.0:1787383424.795255:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1787383424.795266:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+10:13716:x1874206962853760:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383424.795597:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+10:13716:x1874206962853760:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 331us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.795608:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1787383424.813418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.813596:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962853888 00000100:00100000:2.0:1787383424.813609:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962853888 00000100:00100000:2.0:1787383424.813676:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1787383424.813687:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+10:13716:x1874206962853888:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383424.814207:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+10:13716:x1874206962853888:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 520us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.814216:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1787383424.833244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.833364:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854016 00000100:00100000:2.0:1787383424.833383:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854016 00000100:00100000:2.0:1787383424.833439:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1787383424.833447:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1874206962854016:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383424.833476:0:14836:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e7402715-e6da-4c59-9e36-8e96e26e21ad@192.168.202.19@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1787383424.833555:0:14836:0:(genops.c:1406:class_connect()) connect: client e7402715-e6da-4c59-9e36-8e96e26e21ad, cookie 0x42020b050d5cfe60 00000004:00100000:2.0:1787383424.833585:0:14836:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787383424.833591:0:14836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787383424.905276:0:14836:0:(import.c:65:import_set_state_nolock()) ffff9ffc3d02e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383424.905396:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2347:x1874206962854016:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 71946us (72160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.905410:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1787383424.923646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383424.923709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.923933:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854272 00000100:00100000:1.0:1787383424.923944:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854272 00000100:00100000:1.0:1787383424.924024:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854144 00000100:00100000:1.0:1787383424.924028:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854144 00000100:00100000:1.0:1787383424.924055:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1787383424.924064:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:13693:x1874206962854272:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787383424.924111:0:14181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787383424.924197:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:13693:x1874206962854272:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 132us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.924206:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1787383424.924243:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383424.924270:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:0:x1874206962854144:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787383424.924306:0:14182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1787383424.924433:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383424.924953:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:0:x1874206962854144:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 691us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383424.929558:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1787383424.929659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383424.929786:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854400 00000100:00100000:2.0:1787383424.929799:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854400 00000100:00100000:2.0:1787383424.929903:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1787383424.929925:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13693:x1874206962854400:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787383424.930038:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13693:x1874206962854400:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383424.930046:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1787383424.938091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.938146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383424.938242:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854528 00000100:00100000:3.0:1787383424.938252:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854528 00000100:00100000:3.0:1787383424.938294:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854656 00000100:00100000:3.0:1787383424.938310:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854656 00000100:00100000:3.0:1787383424.938339:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383424.938348:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1874206962854528:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787383424.938383:0:14814:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e7402715-e6da-4c59-9e36-8e96e26e21ad@192.168.202.19@tcp t0 exp 0000000000000000 cur 449 last 0 00000100:00100000:0.0:1787383424.938610:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383424.938616:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1874206962854656:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787383424.938635:0:15532:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e7402715-e6da-4c59-9e36-8e96e26e21ad@192.168.202.19@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1787383424.938657:0:15532:0:(genops.c:1406:class_connect()) connect: client e7402715-e6da-4c59-9e36-8e96e26e21ad, cookie 0x42020b050d5cfe6e 00002000:00100000:0.0:1787383424.938670:0:15532:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e7402715-e6da-4c59-9e36-8e96e26e21ad/ffff9ffc050d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787383424.938681:0:15532:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787383424.939183:0:15532:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787383424.939216:0:15532:0:(import.c:65:import_set_state_nolock()) ffff9ffc050dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383424.939298:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2347:x1874206962854656:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 680us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383424.939307:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000020:00000080:3.0:1787383424.940258:0:14814:0:(genops.c:1406:class_connect()) connect: client e7402715-e6da-4c59-9e36-8e96e26e21ad, cookie 0x42020b050d5cfe67 00002000:00100000:3.0:1787383424.940275:0:14814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e7402715-e6da-4c59-9e36-8e96e26e21ad/ffff9ffc3cb23000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787383424.940288:0:14814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787383424.941086:0:14814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787383424.941120:0:14814:0:(import.c:65:import_set_state_nolock()) ffff9ffc3d02e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383424.941184:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2347:x1874206962854528:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 2835us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383424.941210:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1787383424.943316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383424.943846:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854784 00000100:00100000:1.0:1787383424.943905:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854784 00000100:00100000:1.0:1787383424.944248:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383424.944260:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13693:x1874206962854784:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787383424.951053:0:14183:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6726us 00000004:00200000:0.0:1787383424.983054:0:14183:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787383424.983319:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13693:x1874206962854784:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 39055us (40007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383424.983335:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1787383425.275007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383425.275142:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962854912 00000100:00100000:1.0:1787383425.275169:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962854912 00000100:00100000:1.0:1787383425.275245:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1787383425.275256:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13737:x1874206962854912:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:1.0:1787383425.275276:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383425.275301:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cfe75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b52a expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275366:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275380:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275395:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383425.275631:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787383425.275635:0:14181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383425.275731:0:14181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275769:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cfe75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b52a expref: 8 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275788:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b52a expref: 7 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383425.275797:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:1.0:1787383425.275800:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383425.275803:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aad000, rc 0) 00000100:00100000:1.0:1787383425.276302:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:13737:x1874206962854912:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 1045us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383425.276311:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:3.0:1787383425.546245:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787383426.366352:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e7402715-e6da-4c59-9e36-8e96e26e21ad 00010000:00010000:2.0:1787383426.570363:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383427.415112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.415316:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855040 00000100:00100000:2.0:1787383427.415330:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855040 00000100:00080000:0.0:1787383427.415490:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383427.415573:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383427.415589:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:13789:x1874206962855040:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:2.0:1787383427.415650:0:14182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787383427.415764:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:13789:x1874206962855040:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 180us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.415790:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1787383427.426317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383427.426725:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855168 00000100:00100000:3.0:1787383427.426739:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855168 00000100:00100000:3.0:1787383427.426838:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383427.426852:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:13789:x1874206962855168:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:3.0:1787383427.426933:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383427.427058:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:13789:x1874206962855168:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 209us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383427.427067:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00080000:0.0:1787383427.427193:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383427.433824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383427.434152:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855296 00000100:00100000:1.0:1787383427.434167:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855296 00000100:00100000:1.0:1787383427.434270:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1787383427.434283:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13789:x1874206962855296:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:1.0:1787383427.434331:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383427.434543:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:13789:x1874206962855296:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 262us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383427.434552:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00080000:0.0:1787383427.435520:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787383427.595271:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383427.658199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.658421:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855424 00000100:00100000:2.0:1787383427.658435:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855424 00000100:00100000:2.0:1787383427.658518:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:2.0:1787383427.658532:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+10:13820:x1874206962855424:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383427.658557:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383427.658585:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3519d200/0x42020b050d5cfe83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b531 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.658626:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519d200/0x42020b050d5cfe83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b531 expref: 11 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.658641:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3519d200/0x42020b050d5cfe83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b531 expref: 11 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.658653:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d200, rc 0) 00000100:00100000:2.0:1787383427.658728:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962855424:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 199us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.658747:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1787383427.673831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.674133:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855552 00000100:00100000:2.0:1787383427.674147:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855552 00000100:00100000:2.0:1787383427.674230:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:2.0:1787383427.674244:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962855552:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787383427.674672:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962855552:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 429us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.674681:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1787383427.678526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383427.678653:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855680 00000100:00100000:1.0:1787383427.678668:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855680 00000100:00100000:1.0:1787383427.678751:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:1.0:1787383427.678763:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962855680:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383427.679201:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962855680:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 438us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383427.679211:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:3.0:1787383427.692752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383427.693037:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855808 00000100:00100000:1.0:1787383427.693051:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855808 00000100:00100000:1.0:1787383427.693133:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1787383427.693144:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+11:13828:x1874206962855808:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383427.693551:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+11:13828:x1874206962855808:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 408us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383427.693560:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1787383427.708146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.708332:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962855936 00000100:00100000:2.0:1787383427.708346:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962855936 00000100:00100000:2.0:1787383427.708421:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1787383427.708434:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+11:13828:x1874206962855936:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383427.708844:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+11:13828:x1874206962855936:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 412us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.708854:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1787383427.713445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.713922:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856064 00000100:00100000:2.0:1787383427.713936:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856064 00000100:00100000:2.0:1787383427.714063:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:2.0:1787383427.714075:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+11:13820:x1874206962856064:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383427.714098:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383427.714122:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3519ca00/0x42020b050d5cfe8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b55b expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.714160:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519ca00/0x42020b050d5cfe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b55b expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.714174:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3519ca00/0x42020b050d5cfe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b55b expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.714199:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519ca00, rc 0) 00000100:00100000:2.0:1787383427.714276:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+12:13820:x1874206962856064:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 203us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.714284:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:3.0:1787383427.717405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383427.726036:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856192 00000100:00100000:1.0:1787383427.726060:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856192 00000100:00100000:1.0:1787383427.726149:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1787383427.726162:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2cd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+12:13820:x1874206962856192:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787383427.726300:0:14172:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787383427.726333:0:14172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787383427.726337:0:14172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787383427.726340:0:14172:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787383427.726342:0:14172:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787383427.727729:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2cd3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+12:13820:x1874206962856192:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1559us (10327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383427.727814:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:0.0:1787383427.734090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.734206:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856320 00000100:00100000:2.0:1787383427.734220:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856320 00000100:00100000:2.0:1787383427.734315:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:2.0:1787383427.734328:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+12:13820:x1874206962856320:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383427.734352:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383427.734377:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b562 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.734415:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.734429:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.734441:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d400, rc 0) 00000100:00100000:2.0:1787383427.734527:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:13820:x1874206962856320:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 201us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.734535:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:3.0:1787383427.740603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383427.744105:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856448 00000100:00100000:0.0:1787383427.744129:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856448 00000100:00100000:0.0:1787383427.744223:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1787383427.744235:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13820:x1874206962856448:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383427.744729:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13820:x1874206962856448:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 493us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383427.744863:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1787383427.753991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383427.754246:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856576 00000100:00100000:1.0:1787383427.754261:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856576 00000100:00100000:1.0:1787383427.754329:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:1.0:1787383427.754342:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+13:13820:x1874206962856576:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383427.754666:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+13:13820:x1874206962856576:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 326us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383427.754676:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:3.0:1787383427.765280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.765535:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856704 00000100:00100000:2.0:1787383427.765549:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856704 00000100:00100000:2.0:1787383427.765630:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:2.0:1787383427.765642:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:13832:x1874206962856704:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383427.766048:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:13832:x1874206962856704:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 407us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.766058:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:3.0:1787383427.768850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383427.769014:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856832 00000100:00100000:0.0:1787383427.769028:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856832 00000100:00100000:0.0:1787383427.769108:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1787383427.769120:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc02bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13832:x1874206962856832:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383427.769471:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc02bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13832:x1874206962856832:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 352us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383427.769480:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:3.0:1787383427.781948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.783169:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962856960 00000100:00100000:2.0:1787383427.783201:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962856960 00000100:00100000:2.0:1787383427.783286:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1787383427.783299:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1874206962856960:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383427.783367:0:14180:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7685e87c-077f-4994-b884-062063d6ea60@192.168.202.19@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1787383427.783433:0:14180:0:(genops.c:1406:class_connect()) connect: client 7685e87c-077f-4994-b884-062063d6ea60, cookie 0x42020b050d5cfe98 00000004:00100000:2.0:1787383427.783486:0:14180:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383427.783666:0:14180:0:(import.c:65:import_set_state_nolock()) ffff9ffc03822000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383427.783770:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:2347:x1874206962856960:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 471us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.783778:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383427.793209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.793301:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857088 00000100:00100000:2.0:1787383427.793316:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857088 00000100:00100000:2.0:1787383427.793424:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383427.793438:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:0:x1874206962857088:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383427.793541:0:14182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787383427.793647:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:0:x1874206962857088:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.793655:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:0.0:1787383427.793801:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383427.805100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.805207:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857216 00000100:00100000:2.0:1787383427.805221:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857216 00000100:00100000:2.0:1787383427.805303:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383427.805315:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857216:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383427.805360:0:14180:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787383427.805465:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857216:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.805474:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1787383427.808731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.809015:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857344 00000100:00100000:2.0:1787383427.809029:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857344 00000100:00100000:2.0:1787383427.809245:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383427.809258:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857344:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787383427.809382:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857344:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 126us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.809391:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383427.811304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383427.811432:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857472 00000100:00100000:0.0:1787383427.811472:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857472 00000100:00100000:0.0:1787383427.811534:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1787383427.811544:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1874206962857472:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787383427.811587:0:15532:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7685e87c-077f-4994-b884-062063d6ea60@192.168.202.19@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787383427.811632:0:15532:0:(genops.c:1406:class_connect()) connect: client 7685e87c-077f-4994-b884-062063d6ea60, cookie 0x42020b050d5cfe9f 00002000:00100000:0.0:1787383427.811648:0:15532:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7685e87c-077f-4994-b884-062063d6ea60/ffff9ffc2aeda000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787383427.811663:0:15532:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787383427.812006:0:15532:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787383427.812059:0:15532:0:(import.c:65:import_set_state_nolock()) ffff9ffc2aedc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383427.812139:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7685e87c-077f-4994-b884-062063d6ea60+6:2347:x1874206962857472:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 595us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383427.812148:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1787383427.812774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383427.812817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383427.812910:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857600 00000100:00100000:0.0:1787383427.812918:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857600 00000100:00100000:0.0:1787383427.812948:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1787383427.812955:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1874206962857600:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787383427.812982:0:14814:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7685e87c-077f-4994-b884-062063d6ea60@192.168.202.19@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787383427.813220:0:14814:0:(genops.c:1406:class_connect()) connect: client 7685e87c-077f-4994-b884-062063d6ea60, cookie 0x42020b050d5cfea6 00002000:00100000:0.0:1787383427.813233:0:14814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7685e87c-077f-4994-b884-062063d6ea60/ffff9ffc2d627000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787383427.813246:0:14814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787383427.813345:0:14814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787383427.813374:0:14814:0:(import.c:65:import_set_state_nolock()) ffff9ffc2d624800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383427.813477:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7685e87c-077f-4994-b884-062063d6ea60+6:2347:x1874206962857600:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 521us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383427.813485:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1787383427.813527:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857728 00000100:00100000:0.0:1787383427.813531:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857728 00000100:00100000:0.0:1787383427.813564:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1787383427.813570:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857728:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787383427.813832:0:14184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787383427.813990:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+6:13820:x1874206962857728:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 419us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383427.813998:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1787383427.954666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383427.954940:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857856 00000100:00100000:2.0:1787383427.954953:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857856 00000100:00100000:2.0:1787383427.955042:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1787383427.955563:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:13853:x1874206962857856:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:2.0:1787383427.955593:0:14180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383427.955624:0:14180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cfead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b58c expref: -99 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.956308:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.956328:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.956345:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383427.957398:0:14180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787383427.957409:0:14180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383427.957597:0:14180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.957645:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5cfead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 8 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.957682:0:14180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 7 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383427.957692:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:2.0:1787383427.957695:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383427.957699:0:14180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519cc00, rc 0) 00000100:00100000:2.0:1787383427.957804:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+7:13853:x1874206962857856:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 2250us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383427.957816:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:2.0:1787383428.619205:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383429.202716:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7685e87c-077f-4994-b884-062063d6ea60 00000001:00100000:2.0:1787383429.202737:0:7504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e7402715-e6da-4c59-9e36-8e96e26e21ad 00010000:00010000:2.0:1787383429.649181:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383429.898165:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383429.898191:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383429.898279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383429.898500:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625216 00000100:00100000:1.0:1787383429.898508:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625216 00000100:00100000:1.0:1787383429.898566:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383429.898575:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979625216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383429.898609:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787383429.898650:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979625216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383429.898657:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787383429.898710:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383429.898752:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383429.899072:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979625472:0@lo:400:kworker.0 00000100:00100000:3.0:1787383429.899104:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383429.899132:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383429.899137:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979625600:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899304:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979625344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383429.899354:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979625856:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899372:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383429.899386:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383429.899390:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979625728:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899410:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383429.899468:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625344 00000100:00100000:2.0:1787383429.899473:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625344 00000100:00100000:2.0:1787383429.899508:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787383429.899515:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3313:x1874206979625344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899552:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3313:x1874206979625344:12345-0@lo:400:kworker.0 Request processed in 37us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383429.899573:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787383429.899605:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625856 00000100:00100000:2.0:1787383429.899609:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625856 00000100:00100000:2.0:1787383429.899635:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625728 00000100:00100000:2.0:1787383429.899637:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625728 00000100:00100000:2.0:1787383429.899652:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383429.899658:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899685:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874206979625856:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383429.899691:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383429.899701:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383429.899705:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979625728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.899723:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874206979625728:12345-0@lo:400:kworker.0 Request processed in 18us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383429.899729:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383429.899824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383429.899852:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625472 00000100:00100000:3.0:1787383429.899856:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625472 00000100:00100000:3.0:1787383429.899912:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383429.899919:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979625472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383429.899949:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979625472:12345-0@lo:400:kworker.0 Request processed in 32us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383429.899955:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787383429.899981:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383429.899986:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383429.899993:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625600 00000100:00100000:3.0:1787383429.899996:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625600 00000100:00100000:3.0:1787383429.900363:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383429.900370:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979625600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383429.900399:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874206979625600:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383429.900404:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383429.900453:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383429.900462:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383429.900490:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383429.900516:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979625984 00000100:00100000:3.0:1787383429.900519:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979625984 00000100:00100000:3.0:1787383429.900540:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383429.900546:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979625984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383429.900568:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787383429.900601:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979625984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383429.900607:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383429.900643:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383429.900672:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874206979625600:0@lo:400:kworker.0 00000100:00100000:3.0:1787383429.900681:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979625472:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.905452:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1874206979625728:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.905473:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb4211d2-6362-43cb-a936-032e5733e3e9:3313:1874206979625344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383429.905488:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1874206979625856:0@lo:400:kworker.0 00000001:00100000:2.0:1787383429.969950:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e7402715-e6da-4c59-9e36-8e96e26e21ad 00000001:00100000:2.0:1787383429.969975:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7685e87c-077f-4994-b884-062063d6ea60 00000040:00080000:0.0:1787383430.090473:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383430.666253:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383431.193410:0:16050:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787383431.529543:0:6624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7685e87c-077f-4994-b884-062063d6ea60 00010000:00010000:2.0:1787383431.693487:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383432.714243:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383433.200721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383433.200787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383433.200930:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858112 00000100:00100000:3.0:1787383433.200947:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858112 00000100:00100000:3.0:1787383433.201043:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383433.201057:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2350:x1874206962858112:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383433.201166:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2350:x1874206962858112:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383433.201175:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:2.0:1787383433.201436:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383433.201669:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962857984 00000100:00100000:1.0:1787383433.201677:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962857984 00000100:00100000:1.0:1787383433.201735:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1787383433.201744:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:2350:x1874206962857984:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383433.201792:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:2350:x1874206962857984:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383433.201799:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:0.0:1787383433.208001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383433.208056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383433.208144:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858240 00000100:00100000:3.0:1787383433.208159:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858240 00000100:00100000:3.0:1787383433.208253:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858368 00000100:00100000:3.0:1787383433.208257:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858368 00000100:00100000:3.0:1787383433.208292:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1787383433.208304:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2350:x1874206962858240:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383433.208435:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2350:x1874206962858240:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 132us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383433.208444:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1787383433.208471:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:3.0:1787383433.208478:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2350:x1874206962858368:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383433.208508:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2350:x1874206962858368:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383433.208514:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00080000:2.0:1787383433.209041:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383433.209067:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383433.210165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383433.210260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383433.210353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383433.210453:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858496 00000100:00100000:0.0:1787383433.210469:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858496 00000100:00100000:0.0:1787383433.210560:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1787383433.210571:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7685e87c-077f-4994-b884-062063d6ea60+6:2350:x1874206962858496:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383433.210650:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7685e87c-077f-4994-b884-062063d6ea60+6:2350:x1874206962858496:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 80us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383433.210658:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:1.0:1787383433.211025:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383433.211400:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858624 00000100:00100000:2.0:1787383433.211439:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858624 00000100:00080000:1.0:1787383433.211520:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383433.211559:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858752 00000100:00100000:0.0:1787383433.211563:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858752 00000100:00100000:3.0:1787383433.211719:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1787383433.211728:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962858624:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383433.211807:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962858624:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 80us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383433.211814:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1787383433.211838:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1787383433.211845:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7685e87c-077f-4994-b884-062063d6ea60+5:2350:x1874206962858752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383433.211890:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7685e87c-077f-4994-b884-062063d6ea60+5:2350:x1874206962858752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383433.211897:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00080000:1.0:1787383433.212206:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787383433.742773:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383434.773359:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787383434.903297:0:16199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffddc7b4000 00000020:00000080:2.0:1787383434.903401:0:16199:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787383434.903408:0:16199:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787383434.903418:0:16199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddc7b6290 20000000:00000080:2.0:1787383434.903426:0:16199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc17156000 uarg=0000000000000000 20000000:01000000:2.0:1787383434.903481:0:16199:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787383434.903488:0:16199:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787383434.903496:0:16199:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787383434.906743:0:16200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787383434.907093:0:16199:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787383434.913302:0:16199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787383434.913427:0:16199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913455:0:16199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbab expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913464:0:16199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913471:0:16199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913482:0:16199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913489:0:16199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913525:0:16199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913591:0:16199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.913609:0:16199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 12 pid: 14174 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.913630:0:16199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626112:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383434.914234:0:16199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.914245:0:16199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.914254:0:16199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626240:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383434.918450:0:16199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.918478:0:16199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.918497:0:16199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626368:0@lo:104: 00000100:00100000:2.0:1787383434.918583:0:16199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383434.918620:0:16199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.918653:0:16199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 18 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.918663:0:16199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626496:0@lo:104: 00000100:00100000:2.0:1787383434.918690:0:16199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383434.918855:0:16199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.918865:0:16199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 18 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.918903:0:16199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626624:0@lo:104: 00000100:00100000:2.0:1787383434.918933:0:16199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383434.919911:0:16199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383434.920179:0:14164:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383434.920200:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979626368 00000100:00100000:1.0:1787383434.920210:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979626368 00000100:00100000:1.0:1787383434.920266:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979626496 00000100:00100000:1.0:1787383434.920270:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979626496 00000100:00100000:1.0:1787383434.920282:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979626624 00000100:00100000:1.0:1787383434.920298:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979626624 00000100:00100000:1.0:1787383434.920385:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383434.920405:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+5:16199:x1874206979626368:12345-0@lo:104: 00010000:00010000:1.0:1787383434.920422:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.920561:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383434.920568:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+5:16199:x1874206979626368:12345-0@lo:104: Request processed in 166us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.920577:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787383434.920583:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383434.920592:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920600:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047400 already unused, calling callback (ffffffffc1cf6c20) 00000100:00100000:1.0:1787383434.920603:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383434.920609:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+4:16199:x1874206979626496:12345-0@lo:104: 00010000:00010000:1.0:1787383434.920617:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383434.920623:0:15538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920632:0:15538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383434.920641:0:15538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383434.920647:0:15538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383434.920653:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383434.920658:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+4:16199:x1874206979626496:12345-0@lo:104: Request processed in 51us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.920664:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383434.920676:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383434.920681:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:16199:x1874206979626624:12345-0@lo:104: 00010000:00010000:1.0:1787383434.920687:0:14164:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920689:0:15538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920696:0:15538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383434.920717:0:14164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787383434.920721:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.920722:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb4211d2-6362-43cb-a936-032e5733e3e9+3:16199:x1874206979626624:12345-0@lo:104: Request processed in 42us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.920728:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787383434.920728:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047400/0x42020b050d5cfc68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfc6f expref: -99 pid: 15480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920742:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383434.920745:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920752:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047000 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383434.920755:0:15538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920761:0:15538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383434.920778:0:15538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383434.920784:0:15538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383434.920801:0:15538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920807:0:15538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383434.920824:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920831:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc17047000/0x42020b050d5cfbf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbff expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920840:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383434.920843:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920849:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519de00 already unused, calling callback (ffffffffc1cf6c20) 10000000:00010000:0.0:1787383434.920852:0:15538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920858:0:15538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383434.920864:0:15538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383434.920949:0:15538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383434.920970:0:15538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920977:0:15538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383434.920983:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.920989:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff9ffc3519de00/0x42020b050d5cfbab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42020b050d5cfbb2 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383434.921004:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383434.921006:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383434.921008:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383434.921044:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979626752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383434.921088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383434.921149:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979626880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383434.921173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383434.921186:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383434.921193:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383434.921194:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383434.921199:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979627008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383434.921223:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383434.921337:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979626752 00000100:00100000:1.0:1787383434.921342:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979626752 00010000:00010000:1.0:1787383434.921365:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 19 pid: 14175 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.921383:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979626880 00000100:00100000:1.0:1787383434.921385:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979626880 00010000:00010000:1.0:1787383434.921407:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 20 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.921418:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627008 00000100:00100000:1.0:1787383434.921421:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627008 00010000:00010000:1.0:1787383434.921430:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 21 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.921447:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383434.921453:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+21:3315:x1874206979626752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383434.921464:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383434.921469:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 21 pid: 14175 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921479:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 21 pid: 14175 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921504:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383434.921536:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+21:3315:x1874206979626752:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.921543:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383434.921556:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383434.921569:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+20:3312:x1874206979626880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383434.921576:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383434.921581:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 20 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921589:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 20 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921599:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383434.921625:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+20:3312:x1874206979626880:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.921631:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383434.921644:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383434.921650:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3e5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979627008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383434.921657:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383434.921661:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 19 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921669:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 19 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.921678:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383434.921698:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3e5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979627008:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.921705:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787383434.922577:0:16199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6b600/0x42020b050d5cfc6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfc68 expref: 18 pid: 14175 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.922596:0:16199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626368:0@lo:104: 00010000:00010000:2.0:1787383434.922611:0:16199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3dc6a000/0x42020b050d5cfbff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfbf8 expref: 17 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.922620:0:16199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626496:0@lo:104: 00010000:00010000:2.0:1787383434.922630:0:16199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99000/0x42020b050d5cfbb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42020b050d5cfbab expref: 16 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383434.922652:0:16199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626624:0@lo:104: 00000100:00100000:1.0:1787383434.922950:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffb029ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb4211d2-6362-43cb-a936-032e5733e3e9:3315:1874206979626752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383434.923388:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979627008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383434.923433:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979626880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383434.927625:0:16199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626112:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383434.936343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383434.936519:0:16199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16199:1874206979626240:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383434.936570:0:16199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.937196:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962858880 00000100:00100000:1.0:1787383434.937207:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962858880 00010000:00010000:1.0:1787383434.937298:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.937354:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1787383434.937366:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1015050f-5d12-4451-a0c1-63e34e492629+13:2349:x1874206962858880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383434.937400:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383434.937408:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.937420:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.937444:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3519d400/0x42020b050d5cfe91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b562 expref: 13 pid: 14174 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.937463:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383434.937576:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1015050f-5d12-4451-a0c1-63e34e492629+12:2349:x1874206962858880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 211us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.937586:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1787383434.941947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383434.943797:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859008 00000100:00100000:1.0:1787383434.943820:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859008 00010000:00010000:1.0:1787383434.943908:0:14167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383434.943969:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1787383434.943981:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1015050f-5d12-4451-a0c1-63e34e492629+12:2348:x1874206962859008:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383434.944009:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383434.944017:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944056:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944083:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc34e99a00/0x42020b050d5cfe59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b500 expref: 12 pid: 14172 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944104:0:14167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944113:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944138:0:14167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944147:0:14167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944156:0:14167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944164:0:14167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944170:0:14167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383434.944175:0:14167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.944185:0:14167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.946449:0:16199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383434.946472:0:16199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.948334:0:14167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.948361:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffc3519c000/0x42020b050d5cfebb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383434.948398:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383434.948727:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1015050f-5d12-4451-a0c1-63e34e492629+11:2348:x1874206962859008:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4739us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383434.948741:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1787383435.020155:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979627136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383435.020253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383435.020838:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383435.020906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383435.020957:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627136 00000100:00100000:1.0:1787383435.020966:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627136 00000100:00100000:1.0:1787383435.021029:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627264 00000100:00100000:1.0:1787383435.021033:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627264 00000100:00100000:1.0:1787383435.021053:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383435.021064:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979627136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383435.021113:0:14817:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383435.021161:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979627136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383435.021170:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383435.021192:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383435.021199:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979627264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383435.021221:0:14817:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787383435.021254:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979627264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383435.028734:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787383435.028809:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383435.028816:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383435.028917:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383435.029073:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383435.029086:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979627648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383435.029171:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383435.029226:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627648 00000100:00100000:1.0:1787383435.029234:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627648 00000100:00100000:1.0:1787383435.029294:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383435.029305:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979627648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383435.029363:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979627648:12345-0@lo:400:kworker.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383435.029370:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787383435.029403:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383435.029422:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979627648:0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.031479:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979627392:0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.031578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383435.031640:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383435.031648:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979627520:0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.031674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383435.031718:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627392 00000100:00100000:2.0:1787383435.031726:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627392 00000100:00100000:2.0:1787383435.031782:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627520 00000100:00100000:2.0:1787383435.031786:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627520 00000100:00100000:2.0:1787383435.031823:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383435.031832:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979627392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.031910:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979627392:12345-0@lo:400:kworker.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383435.031941:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383435.031971:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383435.031978:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979627520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.032009:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874206979627520:12345-0@lo:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383435.032015:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787383435.032036:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383435.032090:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979627136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383435.032127:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1874206979627520:0@lo:400:kworker.0 00000100:00100000:2.0:1787383435.032138:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3ce1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979627392:0@lo:400:kworker.0 00010000:00010000:0.0:1787383435.787086:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383436.300783:0:14177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383436.300796:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc170f4000 from 10 10000000:01000000:3.0:1787383436.300803:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383436.300994:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.301009:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.301033:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383436.301071:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979627776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.301168:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383436.301294:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383436.304699:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627776 00000100:00100000:0.0:1787383436.304722:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627776 00000100:00100000:0.0:1787383436.304812:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787383436.304825:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+16:14177:x1874206979627776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383436.304852:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383436.305207:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc17047400/0x42020b050d5cfec9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfec2 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383436.305270:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc17047400/0x42020b050d5cfec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfec2 expref: 17 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383436.305285:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc17047400/0x42020b050d5cfec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfec2 expref: 17 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383436.305298:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047400, rc 0) 00000100:00100000:0.0:1787383436.305438:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979627776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 616us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383436.305446:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787383436.305600:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979627776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383436.305635:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfec9 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.305648:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfec9 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383436.306230:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979627904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.306285:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383436.306339:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383436.306423:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979627904 00000100:00100000:1.0:1787383436.306432:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979627904 00000100:00100000:1.0:1787383436.306487:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383436.306497:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979627904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.307202:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979627904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 699us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.307214:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383436.307804:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979627904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383436.307894:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383436.307983:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383436.308028:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383436.308301:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628032 00000100:00100000:1.0:1787383436.308308:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628032 00000100:00100000:1.0:1787383436.308366:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787383436.308395:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979628032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.308642:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979628032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.308650:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383436.308923:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383436.310189:0:16250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787383436.310728:0:14177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787383436.310774:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383436.310790:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfec9 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.310805:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e98e00/0x42020b050d5cfec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfec9 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383436.310817:0:14177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787383436.310821:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffc0cefc000 from 10 10000000:01000000:1.0:1787383436.310825:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383436.310918:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.310928:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.310941:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383436.310971:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.311229:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383436.311272:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383436.313227:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628160 00000100:00100000:3.0:1787383436.313247:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628160 00000100:00100000:3.0:1787383436.313333:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383436.313344:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+17:14177:x1874206979628160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383436.313366:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383436.313399:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98800/0x42020b050d5cfed7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfed0 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.313438:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98800/0x42020b050d5cfed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfed0 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.313454:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98800/0x42020b050d5cfed7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfed0 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.313466:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98800, rc 0) 00000100:00100000:3.0:1787383436.313567:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.313597:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383436.314498:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383436.314528:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfed7 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.314556:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfed7 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383436.314672:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.314732:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383436.314788:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383436.315120:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628288 00000100:00100000:2.0:1787383436.315128:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628288 00000100:00100000:3.0:1787383436.315234:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383436.315246:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.315673:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.315683:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787383436.322585:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.323316:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.323450:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383436.323511:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc051bb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383436.325563:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628416 00000100:00100000:3.0:1787383436.325588:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628416 00000100:00100000:3.0:1787383436.326070:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787383436.326111:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.326551:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 451us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.326562:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383436.331638:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d714380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787383436.334327:0:16251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787383436.335497:0:14177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787383436.335544:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383436.335564:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfed7 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.335583:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffb01aad600/0x42020b050d5cfed0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfed7 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383436.335731:0:14177:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383436.335735:0:14177:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ffb037d9000 from 10 10000000:01000000:3.0:1787383436.335739:0:14177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383436.335797:0:14177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.335827:0:14177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.335841:0:14177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383436.335911:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.336420:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383436.336547:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383436.341215:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628544 00000100:00100000:1.0:1787383436.341237:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628544 00000100:00100000:1.0:1787383436.341316:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383436.341328:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+18:14177:x1874206979628544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383436.341351:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383436.341389:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffb01aadc00/0x42020b050d5cfee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42020b050d5cfede expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.341428:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffb01aadc00/0x42020b050d5cfee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42020b050d5cfede expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.341444:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffb01aadc00/0x42020b050d5cfee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42020b050d5cfede expref: 19 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.341480:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aadc00, rc 0) 00000100:00100000:2.0:1787383436.341715:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383436.341739:0:14177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfee5 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383436.341751:0:14177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42020b050d5cfee5 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383436.341856:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.343741:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979628544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2402us (7311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.343757:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787383436.354420:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383436.354507:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383436.354528:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628672 00000100:00100000:1.0:1787383436.354540:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628672 00000100:00100000:1.0:1787383436.354615:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787383436.354629:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc05fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979628672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.355044:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc05fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979628672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.355053:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787383436.355306:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383436.355370:0:14177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383436.355431:0:14177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383436.355488:0:14177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383436.355610:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979628800 00000100:00100000:3.0:1787383436.355616:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979628800 00000100:00100000:3.0:1787383436.355659:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787383436.355668:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979628800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.355949:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:14177:x1874206979628800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.355956:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787383436.356135:0:14177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb4211d2-6362-43cb-a936-032e5733e3e9:14177:1874206979628800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787383436.358385:0:16252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787383436.359592:0:14177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787383436.359645:0:14177:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383436.359662:0:14177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfee5 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383436.359680:0:14177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff9ffc34e99400/0x42020b050d5cfede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42020b050d5cfee5 expref: -99 pid: 14177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.810834:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383436.857324:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383436.861469:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859136 00000100:00100000:0.0:1787383436.861492:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859136 00000100:00100000:1.0:1787383436.870135:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1787383436.870156:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+11:13707:x1874206962859136:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383436.870182:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383436.870208:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffb01aaca00/0x42020b050d5cfeec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b593 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.870251:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffb01aaca00/0x42020b050d5cfeec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b593 expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.870266:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffb01aaca00/0x42020b050d5cfeec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b593 expref: 12 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383436.870294:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aaca00, rc 0) 00000100:00100000:1.0:1787383436.870476:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859136:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 324us (13169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.870485:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1787383436.900748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383436.900798:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859264 00000100:00100000:1.0:1787383436.900814:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859264 00000100:00100000:1.0:1787383436.900916:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:1.0:1787383436.900928:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859264:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.901331:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859264:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 403us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.902954:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:2.0:1787383436.907649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383436.907732:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859392 00000100:00100000:3.0:1787383436.907746:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859392 00000100:00100000:3.0:1787383436.907820:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:3.0:1787383436.907833:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859392:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.908463:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859392:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 629us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.908475:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1787383436.931704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383436.931966:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859520 00000100:00100000:3.0:1787383436.932003:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859520 00000100:00100000:3.0:1787383436.932077:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1787383436.932089:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+12:13707:x1874206962859520:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383436.932115:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383436.932156:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffc34e98200/0x42020b050d5cfef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b59a expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.932202:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffc34e98200/0x42020b050d5cfef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b59a expref: 13 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.932218:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffc34e98200/0x42020b050d5cfef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b59a expref: 13 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383436.932231:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98200, rc 0) 00000100:00100000:3.0:1787383436.932313:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1015050f-5d12-4451-a0c1-63e34e492629+13:13707:x1874206962859520:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 226us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.932322:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:1.0:1787383436.938235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383436.938443:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859648 00000100:00100000:3.0:1787383436.938457:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859648 00000100:00100000:3.0:1787383436.938530:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:3.0:1787383436.938544:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:13707:x1874206962859648:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383436.940052:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:13707:x1874206962859648:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 1499us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383436.940068:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1787383436.954595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383436.959295:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859776 00000100:00100000:1.0:1787383436.959317:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859776 00000100:00100000:1.0:1787383436.959728:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:1.0:1787383436.959742:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13707:x1874206962859776:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383436.960118:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:13707:x1874206962859776:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 378us (5543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383436.960127:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00010000:00010000:3.0:1787383437.837724:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383438.327538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383438.327803:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860416 00000100:00100000:2.0:1787383438.327816:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860416 00000100:00100000:2.0:1787383438.327905:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860032 00000100:00100000:2.0:1787383438.327909:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860032 00000100:00100000:3.0:1787383438.327910:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962859904 00000100:00100000:3.0:1787383438.327914:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962859904 00000100:00100000:2.0:1787383438.327935:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1787383438.327945:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:2351:x1874206962860416:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383438.327970:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1787383438.327976:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:2351:x1874206962859904:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1787383438.328108:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860160 00000100:00100000:0.0:1787383438.328121:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860160 00000100:00100000:0.0:1787383438.328151:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860672 00000100:00100000:0.0:1787383438.328154:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860672 00000100:00100000:0.0:1787383438.328168:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860288 00000100:00100000:0.0:1787383438.328171:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860288 00000100:00100000:0.0:1787383438.328188:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860544 00000100:00100000:0.0:1787383438.328190:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860544 00000100:00100000:0.0:1787383438.328206:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1787383438.328214:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2351:x1874206962860160:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1787383438.328656:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1787383438.328670:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2351:x1874206962860032:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383438.328833:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1015050f-5d12-4451-a0c1-63e34e492629+13:2351:x1874206962859904:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 855us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383438.328843:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00080000:3.0:1787383438.329814:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383438.329825:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383438.329829:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383438.329854:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383438.329906:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962860672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383438.330072:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962860672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 207us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383438.330081:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1787383438.331900:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1787383438.332061:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2351:x1874206962860288:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383438.332160:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2351:x1874206962860288:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 244us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383438.332170:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1787383438.332194:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1787383438.332202:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962860544:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1787383438.332229:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7685e87c-077f-4994-b884-062063d6ea60+5:2351:x1874206962860544:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (4487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383438.332236:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1787383438.335669:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+6:2351:x1874206962860416:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 7705us (8011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383438.335692:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1787383438.338114:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2351:x1874206962860032:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 9437us (10414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383438.338134:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1787383438.338974:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2351:x1874206962860160:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 9739us (10347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383438.338991:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:0.0:1787383438.858561:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383439.346770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383439.347254:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962860800 00000100:00100000:3.0:1787383439.347287:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962860800 00000100:00100000:3.0:1787383439.347377:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1787383439.347390:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:14363:x1874206962860800:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383439.347419:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383439.347453:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5cfefa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5a1 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347543:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347563:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347580:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347596:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347602:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.347609:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.349653:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cff0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.349685:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cff0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.349699:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cff0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383439.349818:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787383439.349823:0:14181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787383439.351461:0:14181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cff0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351498:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351505:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351513:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351521:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.351527:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351536:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351558:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383439.351562:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.351568:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351575:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cff01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351594:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351618:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351623:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351627:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.351631:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351638:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351646:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ffc0c179700) 00010000:00010000:3.0:1787383439.351649:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.351652:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351657:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cff08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351722:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5cfefa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5a1 expref: 8 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351739:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99a00/0x42020b050d5cff0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5a1 expref: 7 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.351747:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc0c179e00) 00010000:00010000:3.0:1787383439.351750:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383439.351759:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e99a00, rc 0) 00000100:00100000:3.0:1787383439.354091:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:14363:x1874206962860800:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 6684us (7319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383439.354120:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1787383439.361565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383439.362038:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861056 00000100:00100000:1.0:1787383439.362055:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861056 00000100:00100000:1.0:1787383439.362147:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383439.362162:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:14363:x1874206962861056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383439.362198:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383439.362229:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5a8 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.362371:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.362391:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.362405:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.366989:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367015:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367029:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367632:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cff2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367652:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cff2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367660:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cff2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383439.367672:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787383439.367971:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367979:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367986:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.367992:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aade00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383439.367997:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368006:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368019:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffc0c179e00) 00010000:00010000:1.0:1787383439.368022:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383439.368027:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368033:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368046:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368058:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368064:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368069:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aad400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:1.0:1787383439.368073:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368079:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368085:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffc01425400) 00010000:00010000:1.0:1787383439.368088:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383439.368090:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.368096:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.371384:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5a8 expref: 10 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.371416:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aace00/0x42020b050d5cff2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5a8 expref: 9 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.371426:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:1.0:1787383439.371430:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383439.371441:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aace00, rc 0) 00000100:00100000:1.0:1787383439.371532:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14363:x1874206962861056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 9373us (9988us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787383439.371543:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1787383439.379792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.379932:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861184 00000100:00100000:0.0:1787383439.379950:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861184 00000100:00100000:0.0:1787383439.380042:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1787383439.380055:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14363:x1874206962861184:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787383439.380398:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14363:x1874206962861184:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 344us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.380407:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1787383439.424753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.433191:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861312 00000100:00100000:2.0:1787383439.433222:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861312 00000100:00100000:2.0:1787383439.433344:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1787383439.433369:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14370:x1874206962861312:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383439.433410:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383439.433443:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cff39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5af expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433553:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433576:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433591:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433609:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433616:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.433622:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434784:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434802:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434811:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434818:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.434824:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434833:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434853:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383439.434895:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.434901:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434909:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5cff40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434927:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434947:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434953:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434959:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.434962:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434969:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434977:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffc035c5900) 00010000:00010000:3.0:1787383439.434980:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.434983:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.434989:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5cff47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.435043:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cff39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5af expref: 10 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.435055:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:3.0:1787383439.435058:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.435062:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5cff39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5af expref: 10 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.435086:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d400, rc 0) 00000100:00100000:3.0:1787383439.435195:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14370:x1874206962861312:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1830us (10460us total) trans 0 rc 301/301 00000100:00100000:3.0:1787383439.435205:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1787383439.460744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.460972:0:14189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861440 00000100:00100000:2.0:1787383439.460987:0:14189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861440 00000100:00100000:2.0:1787383439.461084:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1787383439.461097:0:14189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14370:x1874206962861440:12345-192.168.202.19@tcp:700:lfs.0 00000100:00100000:2.0:1787383439.461217:0:14189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14370:x1874206962861440:12345-192.168.202.19@tcp:700:lfs.0 Request processed in 122us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383439.461226:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1787383439.477853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.478157:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861696 00000100:00100000:0.0:1787383439.478173:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861696 00000100:00100000:0.0:1787383439.478268:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1787383439.478282:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14370:x1874206962861696:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:0.0:1787383439.478378:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383439.478415:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad000/0x42020b050d5cfe7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b52a expref: 9 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.478442:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:0.0:1787383439.478449:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383439.478838:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.478856:0:14180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 5 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.478925:0:14180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.478968:0:14180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 5 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.478983:0:14180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 5 pid: 14180 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383439.479172:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14180:1874206979628928:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383439.479328:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383439.496533:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.496929:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14180:1874206979628928:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383439.496971:0:14180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383439.497378:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861824 00000100:00100000:2.0:1787383439.497388:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861824 00010000:00010000:2.0:1787383439.497435:0:14166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 6 pid: 14180 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383439.497488:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383439.497500:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7685e87c-077f-4994-b884-062063d6ea60+6:2349:x1874206962861824:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383439.497522:0:14166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383439.497531:0:14166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 6 pid: 14180 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.497547:0:14166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 6 pid: 14180 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.497577:0:14166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cfeb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b58c expref: 6 pid: 14180 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.497598:0:14166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:2.0:1787383439.497605:0:14166:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.497790:0:14166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.497801:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.498173:0:14166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383439.498264:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7685e87c-077f-4994-b884-062063d6ea60+5:2349:x1874206962861824:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 764us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383439.498275:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00010000:00010000:0.0:1787383439.498454:0:14180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.498465:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.498502:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.498516:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.498525:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.515273:0:14180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787383439.515309:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.515324:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.515333:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.515849:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.515856:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.515896:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.516052:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425e00) 00010000:00010000:0.0:1787383439.516056:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383439.516063:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.516069:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383439.516102:0:14180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0a43016 reply state 0000000070f55627 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383439.516115:0:14180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383439.516274:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+10:14370:x1874206962861696:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 37989us (38433us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787383439.516305:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:2.0:1787383439.523839:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.523910:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.523927:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.523934:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383439.523941:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.523951:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.523978:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffc0a060f00) 00010000:00010000:2.0:1787383439.523981:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383439.523996:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.524027:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5cff55 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383439.639500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383439.647444:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962861952 00000100:00100000:1.0:1787383439.647469:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962861952 00000100:00100000:1.0:1787383439.647582:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1787383439.647595:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:14378:x1874206962861952:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:1.0:1787383439.647630:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383439.649415:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5b6 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649526:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649546:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649563:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383439.649666:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787383439.649671:0:14836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787383439.649726:0:14836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649761:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5b6 expref: 11 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649786:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad400/0x42020b050d5cff63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5b6 expref: 10 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.649815:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:1.0:1787383439.649831:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383439.649836:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aad400, rc 0) 00000100:00100000:1.0:1787383439.652445:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+10:14378:x1874206962861952:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 4835us (12947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383439.652464:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1787383439.684452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.684606:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962862080 00000100:00100000:2.0:1787383439.684620:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962862080 00000100:00100000:2.0:1787383439.684702:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1787383439.684712:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+5:14379:x1874206962862080:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383439.684739:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383439.684764:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cff6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5bd expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685261:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cff71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685281:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685294:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383439.685384:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787383439.685389:0:14181:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383439.685416:0:14181:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cff71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685445:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cff6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5bd expref: 7 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685467:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519da00/0x42020b050d5cff71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5bd expref: 6 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.685494:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383439.685498:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383439.685502:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519da00, rc 0) 00000100:00100000:2.0:1787383439.685808:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+6:14379:x1874206962862080:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1096us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383439.685818:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1787383439.689419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383439.689736:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962862208 00000100:00100000:1.0:1787383439.689761:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962862208 00000100:00100000:1.0:1787383439.689839:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1787383439.690088:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:14379:x1874206962862208:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1787383439.690123:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383439.690155:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5c4 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690250:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690268:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690337:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690365:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690374:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383439.690402:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697013:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697039:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697053:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.697128:0:14182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787383439.697133:0:14182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383439.697158:0:14182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697173:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697179:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697185:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697191:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aade00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.697195:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697203:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697215:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383439.697234:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383439.697239:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697246:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aade00/0x42020b050d5cff7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697263:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697268:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697274:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697279:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aacc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.697281:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697287:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697295:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffc01425900) 00010000:00010000:0.0:1787383439.697299:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383439.697302:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697308:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5cff86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697372:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aad200/0x42020b050d5cff78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5c4 expref: 8 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697415:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5c4 expref: 7 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.697425:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060a00) 00010000:00010000:0.0:1787383439.697428:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383439.697431:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046c00, rc 0) 00000100:00100000:0.0:1787383439.697520:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+7:14379:x1874206962862208:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 7669us (8114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.697529:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1787383439.702183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.702270:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962862464 00000100:00100000:0.0:1787383439.702280:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962862464 00000100:00100000:0.0:1787383439.702402:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1787383439.702423:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+7:14379:x1874206962862464:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383439.702444:0:14180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383439.702469:0:14180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cff94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5cb expref: -99 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.702593:0:14180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787383439.702734:0:14180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cff94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5cb expref: 9 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.702751:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383439.702754:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383439.702759:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cff94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5cb expref: 9 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.702791:0:14180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047600, rc 0) 00000100:00100000:0.0:1787383439.702861:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+8:14379:x1874206962862464:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 441us (686us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787383439.702907:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1787383439.707078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.717207:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962862720 00000100:00100000:2.0:1787383439.717224:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962862720 00000100:00100000:2.0:1787383439.717321:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1787383439.717333:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+8:14379:x1874206962862720:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:2.0:1787383439.717407:0:14181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383439.717435:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5cff8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5c4 expref: 8 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.717456:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060a00) 00010000:00010000:2.0:1787383439.717469:0:14181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383439.717496:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.717509:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.717518:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383439.717751:0:14181:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd57893f reply state 000000007a774178 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383439.717778:0:14181:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787383439.717794:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787383439.717907:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+9:14379:x1874206962862720:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 575us (10840us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787383439.717915:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1787383439.722324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1787383439.723139:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723154:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723162:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723168:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519cc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.723172:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723180:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723202:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc035c5300) 00010000:00010000:0.0:1787383439.723205:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787383439.723211:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.723217:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5cffa2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383439.723261:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962862976 00000100:00100000:0.0:1787383439.723282:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962862976 00000100:00100000:0.0:1787383439.723338:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1787383439.723358:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+8:14379:x1874206962862976:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383439.723639:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+9:14379:x1874206962862976:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 291us (1323us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787383439.723647:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1787383439.727283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383439.727426:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962863232 00000100:00100000:3.0:1787383439.727436:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962863232 00000100:00100000:3.0:1787383439.727501:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1787383439.727512:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+9:14379:x1874206962863232:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383439.727538:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383439.727562:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5cffa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5d2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727644:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727661:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727820:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727861:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727901:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.727911:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383439.728056:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787383439.728158:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728167:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728173:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728180:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.728184:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728191:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728203:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383439.728206:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.728210:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728228:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5cffb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728242:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728249:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728254:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728259:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:3.0:1787383439.728263:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728269:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728277:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffc0c179700) 00010000:00010000:3.0:1787383439.728280:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383439.728282:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728288:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5cffb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728332:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5cffa9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d2 expref: 11 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728364:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:3.0:1787383439.728366:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383439.728370:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5cffa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d2 expref: 11 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.728380:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98000, rc 0) 00000100:00100000:3.0:1787383439.728446:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7685e87c-077f-4994-b884-062063d6ea60+10:14379:x1874206962863232:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 935us (1174us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787383439.728454:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1787383439.732953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.733057:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962863360 00000100:00100000:0.0:1787383439.733068:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962863360 00000100:00100000:0.0:1787383439.733132:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1787383439.733143:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+10:14379:x1874206962863360:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1787383439.733169:0:14180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383439.733193:0:14180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cffc5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5d9 expref: -99 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733281:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733295:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733307:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.733373:0:14180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787383439.733377:0:14180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383439.733401:0:14180:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733446:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cffc5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 12 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733484:0:14180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 11 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.733493:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060000) 00010000:00010000:0.0:1787383439.733496:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383439.733500:0:14180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046000, rc 0) 00000100:00100000:0.0:1787383439.733559:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7685e87c-077f-4994-b884-062063d6ea60+11:14379:x1874206962863360:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 417us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.733567:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1787383439.747743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.747834:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962863488 00000100:00100000:0.0:1787383439.747847:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962863488 00000100:00100000:0.0:1787383439.747954:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1787383439.747966:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+11:14379:x1874206962863488:12345-192.168.202.19@tcp:37:lfs.0 00000100:00100000:0.0:1787383439.752060:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7685e87c-077f-4994-b884-062063d6ea60+11:14379:x1874206962863488:12345-192.168.202.19@tcp:37:lfs.0 Request processed in 4085us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.752076:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1787383439.757294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.757440:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962863744 00000100:00100000:2.0:1787383439.757452:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962863744 00000100:00100000:2.0:1787383439.757527:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1787383439.757538:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce45850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7685e87c-077f-4994-b884-062063d6ea60+11:14379:x1874206962863744:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383439.757829:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce45850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7685e87c-077f-4994-b884-062063d6ea60+12:14379:x1874206962863744:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 292us (548us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787383439.757838:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1787383439.806738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.806855:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962863872 00000100:00100000:0.0:1787383439.806908:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962863872 00000100:00100000:0.0:1787383439.806974:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1787383439.806985:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+10:14385:x1874206962863872:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383439.807005:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383439.807028:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cffd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5e0 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807097:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807127:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807141:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807156:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807164:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807169:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807290:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cffe8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807300:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cffe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807309:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cffe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.807355:0:14182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787383439.807358:0:14182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383439.807424:0:14182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cffe8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807439:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807457:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807463:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807469:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.807474:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807483:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807497:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:0.0:1787383439.807500:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383439.807505:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807511:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5cffda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807526:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807532:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807538:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807544:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383439.807553:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807560:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807569:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffc0a060b00) 00010000:00010000:0.0:1787383439.807572:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383439.807575:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807580:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5cffe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807616:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5cffd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e0 expref: 12 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807631:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047000/0x42020b050d5cffe8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e0 expref: 11 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.807639:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060000) 00010000:00010000:0.0:1787383439.807641:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787383439.807644:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17047000, rc 0) 00000100:00100000:0.0:1787383439.807707:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+11:14385:x1874206962863872:12345-192.168.202.19@tcp:101:bash.0 Request processed in 723us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.807714:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1787383439.811679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.811824:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962864128 00000100:00100000:0.0:1787383439.811837:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962864128 00000100:00100000:0.0:1787383439.811972:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1787383439.811984:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+11:14385:x1874206962864128:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383439.812034:0:14180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383439.812061:0:14180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5cffef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5e7 expref: -99 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.812250:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.812277:0:14180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 11 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.812288:0:14180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.812338:0:14180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 11 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.812367:0:14180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 11 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383439.812385:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14180:1874206979629056:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383439.812507:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383439.823903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.824124:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d219c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14180:1874206979629056:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383439.824160:0:14180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383439.824295:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962864256 00000100:00100000:3.0:1787383439.824304:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962864256 00010000:00010000:3.0:1787383439.824363:0:14167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 12 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383439.824403:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383439.824426:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7685e87c-077f-4994-b884-062063d6ea60+12:2348:x1874206962864256:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383439.824441:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383439.824448:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 12 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824460:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 12 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824485:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046000/0x42020b050d5cffcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5d9 expref: 12 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824516:0:14167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060000) 00010000:00010000:3.0:1787383439.824521:0:14167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824531:0:14167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824539:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383439.824569:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383439.824637:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7685e87c-077f-4994-b884-062063d6ea60+11:2348:x1874206962864256:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 213us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383439.824645:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00010000:00010000:2.0:1787383439.824823:0:14180:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.824831:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.824855:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.824915:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.824924:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825684:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825697:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825705:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383439.825718:0:14180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787383439.825750:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825756:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825763:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825768:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383439.825772:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825780:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825803:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060000) 00010000:00010000:2.0:1787383439.825805:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383439.825810:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825815:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5cfff6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383439.825829:0:14180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006808af49 reply state 00000000f2672aec transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383439.825837:0:14180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787383439.825931:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5cffef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825947:0:14180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 13 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.825956:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383439.825959:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787383439.825961:0:14180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519dc00, rc 0) 00000100:00100000:2.0:1787383439.826025:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14385:x1874206962864128:12345-192.168.202.19@tcp:101:bash.0 Request processed in 14044us (14361us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787383439.826034:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:2.0:1787383439.834056:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834075:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834100:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834106:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383439.834112:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834120:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834139:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383439.834142:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383439.834147:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.834152:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5cfffd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383439.848772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.849506:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962864384 00000100:00100000:0.0:1787383439.849520:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962864384 00000100:00100000:0.0:1787383439.849635:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1787383439.849648:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14385:x1874206962864384:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1787383439.849678:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383439.849705:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5d0012 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5ee expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.849803:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.849818:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.849830:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383439.849910:0:14182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787383439.849924:0:14182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383439.849945:0:14182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.849958:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.849984:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047600/0x42020b050d5d0012 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 15 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.850002:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 14 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383439.850010:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383439.850014:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383439.850017:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383439.850084:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14385:x1874206962864384:12345-192.168.202.19@tcp:101:bash.0 Request processed in 439us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383439.850091:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1787383439.855542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383439.855636:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962864640 00000100:00100000:0.0:1787383439.855646:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962864640 00000100:00100000:0.0:1787383439.856083:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1787383439.856096:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14385:x1874206962864640:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:0.0:1787383439.856648:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14385:x1874206962864640:12345-192.168.202.19@tcp:35:bash.0 Request processed in 553us (1115us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787383439.856658:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:1.0:1787383439.882189:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383439.977686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.977761:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962864896 00000100:00100000:2.0:1787383439.977772:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962864896 00000100:00100000:2.0:1787383439.977840:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1787383439.977860:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14395:x1874206962864896:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1787383439.977915:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383439.977945:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5f5 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383439.978068:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787383439.978198:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0020 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5f5 expref: 17 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.978233:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffc01425400) 00010000:00010000:2.0:1787383439.978236:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383439.978242:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5f5 expref: 17 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383439.978257:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d800, rc 0) 00000100:00100000:2.0:1787383439.978339:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14395:x1874206962864896:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 490us (670us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787383439.978356:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1787383439.988402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383439.988490:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962865152 00000100:00100000:2.0:1787383439.988502:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962865152 00000100:00100000:2.0:1787383439.988564:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1787383439.988576:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14395:x1874206962865152:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1787383439.988862:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14395:x1874206962865152:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 278us (462us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787383439.988893:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1787383440.043106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383440.043251:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962865408 00000100:00100000:3.0:1787383440.043261:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962865408 00000100:00100000:3.0:1787383440.043358:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1787383440.043370:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14398:x1874206962865408:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1787383440.043395:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383440.043417:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d002e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b5fc expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383440.043538:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5d0035 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383440.043555:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5d0035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383440.043586:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5d0035 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383440.043600:0:14181:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787383440.043738:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d002e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5fc expref: 20 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383440.043757:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5d0035 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5fc expref: 19 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383440.043765:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:3.0:1787383440.043768:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383440.043772:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98600, rc 0) 00000100:00100000:3.0:1787383440.043829:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14398:x1874206962865408:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 462us (735us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787383440.043836:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00080000:2.0:1787383440.044672:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383440.056044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383440.056097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.056243:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962865664 00000100:00100000:0.0:1787383440.056254:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962865664 00000100:00100000:0.0:1787383440.056315:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1787383440.056325:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14398:x1874206962865664:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1787383440.056402:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056434:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056447:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056475:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056482:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056488:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056494:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047a00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383440.056512:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056520:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056534:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.056537:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383440.056541:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.056547:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d0043 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383440.056626:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14398:x1874206962865664:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 302us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.056634:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1787383440.057240:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962865536 00000100:00100000:2.0:1787383440.057247:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962865536 00000100:00100000:2.0:1787383440.057297:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1787383440.057305:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:2350:x1874206962865536:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383440.057318:0:14166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383440.057336:0:14166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98600/0x42020b050d5d0035 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5fc expref: 19 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.057376:0:14166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383440.057380:0:14166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383440.057431:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:2350:x1874206962865536:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 127us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383440.057438:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383440.064908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.065066:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962865920 00000100:00100000:0.0:1787383440.065078:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962865920 00000100:00100000:0.0:1787383440.065137:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383440.065148:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:14398:x1874206962865920:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1787383440.065423:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14398:x1874206962865920:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 276us (569us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787383440.065431:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383440.138235:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383440.138258:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979629184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383440.138327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383440.138517:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383440.138527:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc37fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979629312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383440.138556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383440.138594:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629184 00000100:00100000:1.0:1787383440.138602:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629184 00000100:00100000:1.0:1787383440.138646:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629312 00000100:00100000:1.0:1787383440.138649:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629312 00000100:00100000:1.0:1787383440.138667:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383440.138675:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979629184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383440.138711:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787383440.138754:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874206979629184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383440.138761:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383440.138781:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383440.138802:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979629312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383440.138822:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787383440.138854:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979629312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383440.138860:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787383440.138898:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383440.138903:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383440.138933:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc37fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979629312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383440.138966:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1874206979629184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383440.139145:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979629824:0@lo:400:kworker.0 00000100:00100000:2.0:1787383440.139178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383440.139209:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383440.139215:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979629440:0@lo:400:kworker.0 00000100:00100000:2.0:1787383440.139241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383440.139313:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629440 00000100:00100000:0.0:1787383440.139317:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629440 00000100:00100000:0.0:1787383440.139380:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383440.139388:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979629440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383440.139425:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3312:x1874206979629440:12345-0@lo:400:kworker.0 Request processed in 39us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.139432:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383440.139468:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb4211d2-6362-43cb-a936-032e5733e3e9:3312:1874206979629440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383440.139487:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629824 00000100:00100000:0.0:1787383440.139491:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629824 00000100:00100000:0.0:1787383440.139521:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383440.139528:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979629824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383440.139562:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874206979629824:12345-0@lo:400:kworker.0 Request processed in 35us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.139567:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383440.139590:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1874206979629824:0@lo:400:kworker.0 00000100:00100000:1.0:1787383440.141510:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979629696:0@lo:400:kworker.0 00000100:00100000:1.0:1787383440.141577:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383440.141630:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383440.141638:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979629568:0@lo:400:kworker.0 00000100:00100000:1.0:1787383440.141665:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787383440.141710:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383440.141803:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629696 00000100:00100000:2.0:1787383440.141811:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629696 00000100:00100000:2.0:1787383440.141894:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979629568 00000100:00100000:2.0:1787383440.141898:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979629568 00000100:00100000:2.0:1787383440.141917:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383440.141927:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383440.141981:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874206979629696:12345-0@lo:400:kworker.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383440.141988:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383440.142008:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787383440.142015:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979629568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383440.142067:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874206979629568:12345-0@lo:400:kworker.0 Request processed in 52us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383440.142074:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787383440.145609:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383440.145684:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874206979629568:0@lo:400:kworker.0 00000100:00100000:1.0:1787383440.145705:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1874206979629696:0@lo:400:kworker.0 00000001:00080000:0.0:1787383440.191580:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1787383440.191600:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787383440.191621:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:2.0:1787383440.331706:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383440.403839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383440.404043:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962866176 00000100:00100000:2.0:1787383440.404070:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962866176 00000100:00100000:2.0:1787383440.404155:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1787383440.404166:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+11:14429:x1874206962866176:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1787383440.404193:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383440.404224:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d004a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b603 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.404335:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5d0051 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.404360:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5d0051 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.404373:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5d0051 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383440.404386:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787383440.404628:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d004a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b603 expref: 14 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.404649:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5d0051 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b603 expref: 13 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.404657:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383440.404661:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383440.404664:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519de00, rc 0) 00000100:00100000:2.0:1787383440.404737:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14429:x1874206962866176:12345-192.168.202.19@tcp:101:cat.0 Request processed in 572us (913us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787383440.404763:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1787383440.412561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383440.412610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.412731:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962866432 00000100:00100000:0.0:1787383440.412745:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962866432 00000100:00100000:1.0:1787383440.412895:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962866560 00000100:00100000:1.0:1787383440.412900:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962866560 00000100:00100000:1.0:1787383440.412975:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1787383440.412988:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:2349:x1874206962866560:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383440.413008:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383440.413043:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519de00/0x42020b050d5d0051 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b603 expref: 14 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383440.413096:0:14165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:1.0:1787383440.413103:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383440.413258:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1787383440.413268:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14429:x1874206962866432:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1787383440.413783:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14429:x1874206962866432:12345-192.168.202.19@tcp:35:cat.0 Request processed in 515us (1236us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787383440.413793:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1787383440.413854:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:2349:x1874206962866560:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 870us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383440.413862:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1787383440.518969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.520021:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962866816 00000100:00100000:0.0:1787383440.520038:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962866816 00000100:00100000:0.0:1787383440.520137:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:0.0:1787383440.520149:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14435:x1874206962866816:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1787383440.520176:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383440.520198:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d005f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b60a expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520323:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520351:0:14182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520360:0:14182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 14 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520368:0:14182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520407:0:14182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 14 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520421:0:14182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 14 pid: 14182 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383440.520434:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14182:1874206979629952:192.168.202.19@tcp:104: 00010000:00010000:0.0:1787383440.520567:0:14182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.520592:0:14182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383440.520602:0:14182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14182:1874206979630080:192.168.202.19@tcp:104: 00000100:00100000:0.0:1787383440.520631:0:14182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3fc2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383440.535203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383440.535263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383440.535364:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867072 00000100:00100000:2.0:1787383440.535380:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867072 00010000:00010000:2.0:1787383440.535445:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 15 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383440.535487:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d218380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14182:1874206979629952:192.168.202.19@tcp:104: 00000100:00100000:2.0:1787383440.535501:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962866944 00000100:00100000:2.0:1787383440.535507:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962866944 00000100:00100000:0.0:1787383440.535509:0:14182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14182:1874206979630080:192.168.202.19@tcp:104: 00010000:00010000:2.0:1787383440.535527:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 16 pid: 14182 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.535548:0:14182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383440.535550:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383440.535569:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3e5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:2349:x1874206962867072:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787383440.535639:0:14167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787383440.535651:0:14167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787383440.535978:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1787383440.535991:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:2349:x1874206962866944:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383440.536012:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383440.536023:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 16 pid: 14182 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.536038:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 16 pid: 14182 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.536066:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0019 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5ee expref: 16 pid: 14182 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.536086:0:14167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.536091:0:14167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.536129:0:14167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.536136:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383440.536201:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:2349:x1874206962866944:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 213us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.536210:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00010000:00010000:2.0:1787383440.540227:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383440.540247:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540267:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540292:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0004 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b5e7 expref: 14 pid: 14180 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540311:0:14165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383440.540316:0:14165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540353:0:14165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540361:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.540393:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383440.540451:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3e5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:2349:x1874206962867072:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4885us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383440.540461:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00010000:00010000:0.0:1787383440.542898:0:14182:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.542933:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383440.542966:0:14182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383440.543240:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047a00/0x42020b050d5d005f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b60a expref: 14 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.543266:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046e00/0x42020b050d5d0066 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b60a expref: 13 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.543276:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.543280:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383440.543284:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046e00, rc 0) 00000100:00100000:0.0:1787383440.543379:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14435:x1874206962866816:12345-192.168.202.19@tcp:101:dd.0 Request processed in 23232us (24424us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787383440.543391:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:1.0:1787383440.548610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383440.548755:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867328 00000100:00100000:2.0:1787383440.548769:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867328 00000100:00100000:2.0:1787383440.548848:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1787383440.548861:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:14435:x1874206962867328:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1787383440.549427:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.549450:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.549465:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383440.549532:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787383440.549582:0:14836:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000146a81d8 reply state 00000000850475dd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383440.549594:0:14836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383440.549828:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffb029af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14435:x1874206962867328:12345-192.168.202.19@tcp:36:dd.0 Request processed in 966us (1231us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787383440.549854:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000020:00080000:2.0:1787383440.549860:0:14836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787383440.554180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1787383440.554263:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554308:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554317:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554323:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519dc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383440.554329:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554348:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554373:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.554376:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383440.554382:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.554389:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519dc00/0x42020b050d5d0074 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383440.554495:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867456 00000100:00100000:1.0:1787383440.554510:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867456 00000100:00100000:1.0:1787383440.554586:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1787383440.554599:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14435:x1874206962867456:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:1.0:1787383440.554632:0:14180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383440.554654:0:14180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5d007b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b611 expref: -99 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383440.554842:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5d007b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b611 expref: 16 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383440.554860:0:14180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5d007b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b611 expref: 16 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383440.554933:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:1.0:1787383440.554936:0:14180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383440.554949:0:14180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffb01aacc00, rc 0) 00000100:00100000:1.0:1787383440.555036:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14435:x1874206962867456:12345-192.168.202.19@tcp:101:dd.0 Request processed in 438us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383440.555045:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1787383440.573119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.573319:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867712 00000100:00100000:0.0:1787383440.573330:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867712 00000100:00100000:0.0:1787383440.573418:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1787383440.573430:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14435:x1874206962867712:12345-192.168.202.19@tcp:103:dd.0 00010000:00010000:0.0:1787383440.573447:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383440.573474:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffb01aacc00/0x42020b050d5d007b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b611 expref: 16 pid: 14180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.573517:0:14167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.573522:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383440.573587:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14435:x1874206962867712:12345-192.168.202.19@tcp:103:dd.0 Request processed in 159us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.573595:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1787383440.577752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383440.577862:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867840 00000100:00100000:2.0:1787383440.577898:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867840 00000100:00100000:2.0:1787383440.577969:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1787383440.577980:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14435:x1874206962867840:12345-192.168.202.19@tcp:58:dd.0 00010000:00010000:2.0:1787383440.580287:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.580311:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383440.580324:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383440.582795:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383440.583719:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787383440.583797:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787383440.585251:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14435:x1874206962867840:12345-192.168.202.19@tcp:58:dd.0 Request processed in 7261us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383440.585266:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:1.0:1787383440.592969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383440.593267:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962867968 00000100:00100000:0.0:1787383440.593278:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962867968 00000100:00100000:0.0:1787383440.593353:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1787383440.593365:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14435:x1874206962867968:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1787383440.593387:0:14182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383440.593408:0:14182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b618 expref: -99 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593471:0:14182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593482:0:14182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 16 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593503:0:14182:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593518:0:14182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 16 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593534:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383440.593551:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383440.593555:0:14182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 16 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383440.593563:0:14182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc17046800, rc 0) 00000100:00100000:0.0:1787383440.593632:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14435:x1874206962867968:12345-192.168.202.19@tcp:101:dd.0 Request processed in 269us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383440.593640:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00010000:00010000:3.0:1787383440.906123:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383441.354157:0:14212:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787383441.354168:0:14212:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787383441.354219:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787383441.354226:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787383441.354370:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c8cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14212:1874206979630208:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383441.354483:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08f12900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383441.359958:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c8cf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14212:1874206979630208:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383441.363544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383441.363777:0:14191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868096 00000100:00100000:1.0:1787383441.363788:0:14191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868096 00000100:00100000:1.0:1787383441.363849:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383441.363860:0:14191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868096:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787383441.363978:0:14191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868096:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383441.363987:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383441.368797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.368893:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868224 00000100:00100000:3.0:1787383441.368903:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868224 00000100:00100000:3.0:1787383441.368981:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1787383441.368992:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868224:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787383441.369026:0:14181:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787383441.369413:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868224:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 421us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383441.369422:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1787383441.387295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.387451:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868352 00000100:00100000:0.0:1787383441.387463:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868352 00000100:00100000:0.0:1787383441.387537:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1787383441.387550:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868352:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787383441.387640:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387656:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387669:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387726:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387735:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387742:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387767:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387793:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387801:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383441.387846:0:14182:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787383441.387850:0:14182:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787383441.387865:0:14182:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387913:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387919:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387926:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387931:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.387936:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387944:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387956:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:0.0:1787383441.387959:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.387963:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387981:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046200/0x42020b050d5d0090 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.387998:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388004:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388010:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388016:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.388019:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388026:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388034:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ffc0a060b00) 00010000:00010000:0.0:1787383441.388037:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.388039:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388045:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d0097 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388062:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388068:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388081:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388085:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.388089:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388095:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388103:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:0.0:1787383441.388105:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.388108:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.388115:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d009e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.388197:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868352:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 649us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383441.388206:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1787383441.394356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.394503:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868608 00000100:00100000:2.0:1787383441.394516:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868608 00000100:00100000:2.0:1787383441.394585:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1787383441.394597:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:14436:x1874206962868608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.394622:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383441.394646:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b61f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.394758:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.394773:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.394785:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383441.394796:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787383441.396778:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396796:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396804:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396809:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d400 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.396828:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396837:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396855:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383441.396858:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383441.396863:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396901:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396964:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b61f expref: 18 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396975:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffc01425a00) 00010000:00010000:2.0:1787383441.396978:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383441.396982:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b61f expref: 18 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.396992:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519cc00, rc 0) 00000100:00100000:2.0:1787383441.397082:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14436:x1874206962868608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2486us (2735us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787383441.397092:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1787383441.402225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.402372:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868736 00000100:00100000:0.0:1787383441.402386:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868736 00000100:00100000:0.0:1787383441.402460:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1787383441.402472:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14436:x1874206962868736:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383441.402527:0:14182:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383441.402657:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14436:x1874206962868736:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 186us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383441.402679:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1787383441.413459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.413573:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962868992 00000100:00100000:3.0:1787383441.413584:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962868992 00000100:00100000:3.0:1787383441.413642:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1787383441.413650:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:14436:x1874206962868992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383441.413667:0:14181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383441.413690:0:14181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d00ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b626 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383441.414523:0:14181:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1787383441.414534:0:14181:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787383441.414598:0:14181:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787383441.415266:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d00c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.415283:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d00c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.415295:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d00c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.415378:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d00ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b626 expref: 20 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.415398:0:14181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d00c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b626 expref: 19 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.415424:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc0c179700) 00010000:00010000:3.0:1787383441.415427:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383441.415431:0:14181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98400, rc 0) 00000100:00100000:3.0:1787383441.415574:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14436:x1874206962868992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1923us (2125us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787383441.415583:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1787383441.432475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.432604:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962869248 00000100:00100000:0.0:1787383441.432614:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962869248 00000100:00100000:0.0:1787383441.432678:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1787383441.432690:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14436:x1874206962869248:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383441.432761:0:14182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383441.432793:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d00c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b626 expref: 19 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432815:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc0c179700) 00010000:00010000:0.0:1787383441.432828:0:14182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383441.432905:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432920:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432931:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432945:0:14182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432952:0:14182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.432959:0:14182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433252:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433717:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433729:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433735:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047200 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.433739:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433748:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433762:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffc0a060000) 00010000:00010000:0.0:1787383441.433765:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.433769:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433774:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17047200/0x42020b050d5d00cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433788:0:14182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433794:0:14182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433800:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433814:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.433817:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.433824:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.434552:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xde66ecb9 (ffff9ffc0a060b00) 00010000:00010000:0.0:1787383441.434559:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.434564:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.434572:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046c00/0x42020b050d5d00d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xde66ecb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14182 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.434735:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:14436:x1874206962869248:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 2043us (2266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383441.434744:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1787383441.452847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.453082:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962869376 00000100:00100000:2.0:1787383441.453095:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962869376 00000100:00100000:2.0:1787383441.453163:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1787383441.453190:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:14436:x1874206962869376:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.453211:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383441.453236:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b62d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453290:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453305:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453319:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453438:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b62d expref: 20 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453458:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d400/0x42020b050d5d00e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b62d expref: 19 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.453469:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.453472:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383441.453475:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d400, rc 0) 00000100:00100000:2.0:1787383441.453550:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14436:x1874206962869376:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 363us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.453559:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1787383441.460142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.460233:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962869632 00000100:00100000:2.0:1787383441.460245:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962869632 00000100:00100000:2.0:1787383441.460322:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1787383441.460359:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14436:x1874206962869632:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.460465:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.460486:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.460515:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383441.462004:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787383441.462025:0:14180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465676156050ns, next at 466676152345ns, rc = 0 00000004:00010000:2.0:1787383441.462140:0:14180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000341270d0 reply state 00000000cd596d68 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.462151:0:14180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383441.462285:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+21:14436:x1874206962869632:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1924us (2151us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787383441.462294:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00010000:00010000:2.0:1787383441.479742:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479761:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479769:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479774:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519cc00 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.479780:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479802:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479822:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.479825:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383441.479830:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.479836:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.487383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.488957:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962869760 00000100:00100000:2.0:1787383441.488973:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962869760 00000100:00100000:2.0:1787383441.489047:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:2.0:1787383441.489059:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+20:14436:x1874206962869760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.489087:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383441.489110:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b634 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.489173:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 21 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.489188:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 21 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.489207:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.489209:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383441.489214:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519cc00, rc 0) 00000100:00100000:2.0:1787383441.489309:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+21:14436:x1874206962869760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 251us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.489316:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1787383441.499959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.500043:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962869888 00000100:00100000:3.0:1787383441.500054:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962869888 00000100:00100000:3.0:1787383441.500121:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1787383441.500132:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2348:x1874206962869888:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787383441.500497:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2348:x1874206962869888:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 366us (549us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787383441.500506:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:1.0:1787383441.500647:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383441.507956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.510559:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962870144 00000100:00100000:2.0:1787383441.510575:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962870144 00000100:00100000:2.0:1787383441.510660:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383441.510672:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+21:14436:x1874206962870144:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383441.511008:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+22:14436:x1874206962870144:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 337us (3059us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787383441.511017:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1787383441.523689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.524766:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962870400 00000100:00100000:2.0:1787383441.524780:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962870400 00000100:00100000:2.0:1787383441.524863:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1787383441.524910:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+22:14436:x1874206962870400:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383441.525268:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+22:14436:x1874206962870400:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 361us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.525278:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1787383441.539039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.542417:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962870528 00000100:00100000:2.0:1787383441.542434:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962870528 00000100:00100000:2.0:1787383441.542511:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1787383441.542533:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+22:14436:x1874206962870528:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.542555:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383441.542584:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5d00f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b63b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542658:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542687:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542699:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383441.542740:0:14836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787383441.542759:0:14836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542785:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d000/0x42020b050d5d00f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b63b expref: 24 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542804:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b63b expref: 23 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.542813:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.542816:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383441.542820:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519c200, rc 0) 00000100:00100000:2.0:1787383441.542921:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+23:14436:x1874206962870528:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 391us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.542928:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1787383441.552029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.552117:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962870656 00000100:00100000:2.0:1787383441.552127:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962870656 00000100:00100000:2.0:1787383441.552181:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383441.552190:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+6:2348:x1874206962870656:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.552209:0:15532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383441.552246:0:15532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b642 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383441.552274:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e92, blocks: 0x1 00010000:00010000:2.0:1787383441.552295:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1787383441.552299:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383441.552308:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 7 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.552340:0:15532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 7 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.552354:0:15532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc3519d000, rc 0) 00000100:00100000:2.0:1787383441.552415:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2348:x1874206962870656:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 226us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.552422:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1787383441.556086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.556410:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962870912 00000100:00100000:2.0:1787383441.556420:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962870912 00000100:00100000:2.0:1787383441.556484:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1787383441.556496:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+23:14436:x1874206962870912:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383441.556620:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+23:14436:x1874206962870912:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 126us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.556628:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1787383441.559540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.559656:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871040 00000100:00100000:0.0:1787383441.559666:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871040 00000100:00100000:0.0:1787383441.559725:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1787383441.559735:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+23:14436:x1874206962871040:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787383441.615146:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1787383441.615171:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787383441.615180:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787383441.615433:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979630336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787383441.615502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383441.615599:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14436:x1874206962871040:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 55861us (56066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383441.615621:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1787383441.619274:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979630336 00000100:00100000:1.0:1787383441.619293:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979630336 00000100:00100000:1.0:1787383441.619379:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383441.619391:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874206979630336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787383441.619624:0:14816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787383441.619628:0:14816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787383441.619630:0:14816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787383441.619632:0:14816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787383442 -> 1787383442 00002000:00010000:1.0:1787383441.619634:0:14816:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787383441.619718:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874206979630336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 329us (4215us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787383441.619726:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1787383441.622580:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffc3c851f80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787383441.622598:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1874206979630336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787383441.624643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.625234:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871168 00000100:00100000:2.0:1787383441.625245:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871168 00000100:00100000:2.0:1787383441.625310:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383441.625320:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2349:x1874206962871168:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787383441.625487:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2349:x1874206962871168:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 167us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.625495:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1787383441.628122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.628268:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871424 00000100:00100000:2.0:1787383441.628288:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871424 00000100:00100000:2.0:1787383441.628359:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1787383441.628370:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14436:x1874206962871424:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383441.628427:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383441.628456:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c200/0x42020b050d5d0100 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b63b expref: 14 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.628477:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.628483:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383441.628518:0:14180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.628532:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.628542:0:14180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383441.628764:0:14180:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000bbce41d reply state 000000004256d7a6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.628775:0:14180:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383441.628943:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:14436:x1874206962871424:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 573us (829us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787383441.628968:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00010000:00010000:0.0:1787383441.630683:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630699:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630707:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630712:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:0.0:1787383441.630717:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630725:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630740:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:0.0:1787383441.630743:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383441.630747:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.630753:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d010e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14180 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.633276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.633544:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871552 00000100:00100000:3.0:1787383441.633555:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871552 00000100:00100000:3.0:1787383441.633616:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1787383441.633627:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:14436:x1874206962871552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383441.633646:0:14816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383441.633665:0:14816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeeda35c753a6b649 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.633719:0:14816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 8 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.633729:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383441.633734:0:14816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383441.633740:0:14816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 8 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.633775:0:14816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 8 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.633790:0:14816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 8 pid: 15532 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383441.633805:0:14816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14816:1874206979630464:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383441.634094:0:14816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2fcf7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383441.646148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.646539:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871680 00000100:00100000:2.0:1787383441.646550:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871680 00010000:00010000:2.0:1787383441.646603:0:14166:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 9 pid: 15532 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.646649:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383441.646659:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:2348:x1874206962871680:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383441.646674:0:14166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383441.646698:0:14166:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 9 pid: 15532 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.646714:0:14166:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 9 pid: 15532 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.646739:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383441.646744:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383441.646752:0:14166:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.646763:0:14166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.646804:0:14166:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.646857:0:14166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc34c41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14166:1874206979630592:192.168.202.19@tcp:105: 00000100:00100000:2.0:1787383441.646978:0:14166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08f12900 going to sleep for 11 seconds 00010000:00010000:1.0:1787383441.649446:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff1ff17/0x42020b050d5d0107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b642 expref: 9 pid: 15532 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.649471:0:14816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c851180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14816:1874206979630464:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383441.649501:0:14816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 8 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.649517:0:14816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffc34e98000, rc 0) 00000100:00100000:1.0:1787383441.649580:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+8:14436:x1874206962871552:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 15953us (16317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383441.649590:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1787383441.652219:0:14166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc34c41f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14166:1874206979630592:192.168.202.19@tcp:105: 00010000:00010000:3.0:1787383441.652248:0:14166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383441.652315:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2348:x1874206962871680:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5657us (6179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383441.652335:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1787383441.652478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.654936:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871808 00000100:00100000:0.0:1787383441.654951:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871808 00000100:00100000:0.0:1787383441.655022:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1787383441.655033:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2348:x1874206962871808:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787383441.655536:0:15532:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787383441.655541:0:15532:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787383441 00002000:00010000:0.0:1787383441.655544:0:15532:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787383440 00002000:00010000:0.0:1787383441.655547:0:15532:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787383442 -> 1787383441 00002000:00010000:0.0:1787383441.655549:0:15532:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787383441.655625:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+8:2348:x1874206962871808:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 593us (3148us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787383441.655634:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1787383441.666511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383441.666617:0:14814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962871936 00000100:00100000:1.0:1787383441.666640:0:14814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962871936 00000100:00100000:1.0:1787383441.666701:0:14814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1787383441.666711:0:14814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+8:2349:x1874206962871936:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787383441.666755:0:14814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.666776:0:14814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 8 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.666784:0:14814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383441.666789:0:14814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383441.666794:0:14814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.666842:0:14814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 8 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.666858:0:14814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 8 pid: 14816 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.666915:0:14814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14814:1874206979630720:192.168.202.19@tcp:104: 00000100:00100000:1.0:1787383441.666997:0:14814:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc3501df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383441.669742:0:14814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14814:1874206979630720:192.168.202.19@tcp:104: 00010000:00010000:1.0:1787383441.669773:0:14814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.671803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.671927:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872064 00000100:00100000:0.0:1787383441.671937:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872064 00010000:00010000:0.0:1787383441.671981:0:14167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.672026:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1787383441.672036:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+9:2349:x1874206962872064:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383441.672052:0:14167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383441.672075:0:14167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.672089:0:14167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.672114:0:14167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e4380e/0x42020b050d5d0115 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b649 expref: 9 pid: 14816 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.672153:0:14167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383441.672158:0:14167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383441.672164:0:14167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.672175:0:14167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383441.672371:0:14167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383441.672434:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+8:2349:x1874206962872064:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 398us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383441.672443:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:1.0:1787383441.679437:0:14814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679460:0:14814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679507:0:14814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679515:0:14814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679523:0:14814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679530:0:14814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383441.679535:0:14814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679544:0:14814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679569:0:14814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.679604:0:14814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3815059/0x42020b050d5d011c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.679725:0:14814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc34c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2349:x1874206962871936:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 13011us (13218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383441.679735:0:14814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1787383441.686855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.687097:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872320 00000100:00100000:3.0:1787383441.687107:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872320 00000100:00100000:3.0:1787383441.687164:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1787383441.687186:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:14436:x1874206962872320:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787383441.687269:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.687286:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.687299:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.690314:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.690352:0:14181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 15 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.690361:0:14181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.690404:0:14181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 15 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.690419:0:14181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 15 pid: 14836 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383441.690434:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14181:1874206979630848:192.168.202.19@tcp:104: 00000100:00100000:3.0:1787383441.690526:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0698b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383441.704264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383441.704353:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872448 00000100:00100000:1.0:1787383441.704363:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872448 00010000:00010000:1.0:1787383441.704403:0:14165:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 16 pid: 14836 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383441.704450:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1787383441.704460:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:2348:x1874206962872448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383441.704474:0:14165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383441.704481:0:14165:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 16 pid: 14836 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.704494:0:14165:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 16 pid: 14836 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.704517:0:14165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:1.0:1787383441.704522:0:14165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.704532:0:14165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.704548:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.704567:0:14165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383441.704622:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+16:2348:x1874206962872448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383441.704629:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00010000:00010000:3.0:1787383441.704948:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519cc00/0x42020b050d5d00f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b634 expref: 15 pid: 14836 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383441.704978:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14181:1874206979630848:192.168.202.19@tcp:104: 00010000:00010000:3.0:1787383441.705000:0:14181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.705009:0:14181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.705014:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383441.705350:0:14181:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787383441.705501:0:14181:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787383441.705548:0:14181:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787383441.705627:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14181:1874206979630976:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787383441.705703:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383441.705783:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc2e871000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383441.713057:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979630976 00000100:00100000:2.0:1787383441.713073:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979630976 00000100:00100000:2.0:1787383441.713168:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383441.713180:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14181:x1874206979630976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383441.713317:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3c851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14181:x1874206979630976:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383441.713324:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383441.713390:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3c853800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14181:1874206979630976:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787383441.714077:0:14181:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787383441.714162:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14181:1874206979631104:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383441.714222:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383441.714245:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc08f12480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383441.714278:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631104 00000100:00100000:2.0:1787383441.714283:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631104 00000100:00100000:2.0:1787383441.714307:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383441.714314:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14181:x1874206979631104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383441.714519:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14181:x1874206979631104:12345-0@lo:1000:mdt00_001.0 Request processed in 204us (296us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787383441.714536:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383441.714574:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14181:1874206979631104:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787383441.714606:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714616:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714625:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714631:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.714636:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714644:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714662:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.714665:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383441.714670:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714677:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98000/0x42020b050d5d012a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714709:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714716:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714733:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714738:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.714741:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714748:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714757:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383441.714760:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383441.714767:0:14181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 18 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714778:0:14181:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 18 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714787:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 18 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.714814:0:14181:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc17046800/0x42020b050d5d0089 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0xeeda35c753a6b618 expref: 18 pid: 14182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.714826:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14181:1874206979631232:192.168.202.19@tcp:105: 00000100:00100000:2.0:1787383441.714921:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ffc0985e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383441.718449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.718488:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872576 00000100:00100000:0.0:1787383441.718498:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872576 00000100:00100000:0.0:1787383441.718548:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1787383441.718559:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14435:x1874206962872576:12345-192.168.202.19@tcp:49:dd.0 00000100:00100000:0.0:1787383441.718679:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce44c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+19:14435:x1874206962872576:12345-192.168.202.19@tcp:49:dd.0 Request processed in 121us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383441.718688:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1787383441.719032:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14181:1874206979631232:192.168.202.19@tcp:105: 00010000:00010000:2.0:1787383441.719074:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719084:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519d800/0x42020b050d5d0082 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719117:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719131:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719144:0:14181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719155:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719163:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719170:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719176:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519c000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.719180:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719187:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719198:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383441.719206:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383441.719211:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719217:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc3519c000/0x42020b050d5d0131 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719229:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719235:0:14181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719240:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719245:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e99000 already unused, calling callback (ffffffffc21194f0) 00010000:00010000:2.0:1787383441.719248:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719254:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719262:0:14181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffc035c5200) 00010000:00010000:2.0:1787383441.719265:0:14181:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383441.719268:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.719274:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e99000/0x42020b050d5d0123 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14181 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383441.719482:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:14436:x1874206962872320:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 32297us (32649us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787383441.719500:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000020:00080000:2.0:1787383441.719504:0:14181:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787383441.720355:0:14212:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787383441.720366:0:14212:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383441.720734:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787383441.720746:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787383441.727145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.728661:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872832 00000100:00100000:3.0:1787383441.728674:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872832 00000100:00100000:3.0:1787383441.728725:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1787383441.728734:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+18:14436:x1874206962872832:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787383441.732540:0:14184:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787383441.732700:0:14184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787383441.732768:0:14184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732792:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732804:0:14184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732814:0:14184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732820:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732827:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.732864:0:14184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383441.732983:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7402715-e6da-4c59-9e36-8e96e26e21ad+20:14436:x1874206962872832:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 4246us (5847us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787383441.732994:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000020:00080000:3.0:1787383441.733000:0:14184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787383441.740535:0:15538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383441.740551:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.740564:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383441.740569:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.740580:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.740602:0:15538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffc035c5c00) 00010000:00010000:2.0:1787383441.740605:0:15538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383441.740610:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.740617:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffc34e98400/0x42020b050d5d0138 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383441.740633:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383441.740635:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383441.740637:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787383441.759101:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1787383441.759121:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00010000:00010000:1.0:1787383441.930513:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383441.962688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383441.962829:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962872960 00000100:00100000:1.0:1787383441.962855:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962872960 00000100:00100000:1.0:1787383441.963015:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383441.963026:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2348:x1874206962872960:12345-192.168.202.19@tcp:4:dd.0 00002000:00010000:1.0:1787383441.963079:0:14819:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a894e91, atime: 0x6a894e90, ctime: 0x6a894e91, blocks: 0x1 00010000:00010000:1.0:1787383441.963089:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.963109:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=466s v=(0 0) 00010000:00010000:1.0:1787383441.963114:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383441.963121:0:14819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.963138:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.974634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1787383441.975116:0:14821:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787383441.975129:0:14821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787383441.979435:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873088 00000100:00100000:2.0:1787383441.979450:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873088 00000100:00100000:3.0:1787383441.980439:0:16317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1787383441.980455:0:16317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2348:x1874206962873088:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:3.0:1787383441.980499:0:16317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.980517:0:16317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383441.980522:0:16317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383441.980536:0:16317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383441.980551:0:16317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.981950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.982129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1787383441.982219:0:14820:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787383441.982234:0:14820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787383441.983362:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873216 00000100:00100000:0.0:1787383441.983377:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873216 00000100:00100000:0.0:1787383441.983443:0:14820:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383441.983451:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873344 00000100:00100000:0.0:1787383441.983453:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873344 00000100:00100000:1.0:1787383441.986492:0:16318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1787383441.986512:0:16318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7402715-e6da-4c59-9e36-8e96e26e21ad+10:2349:x1874206962873216:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:1.0:1787383441.986551:0:16318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.986569:0:16318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383441.986574:0:16318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383441.986581:0:16318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383441.986595:0:16318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383441.995430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.995608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.995638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1787383441.995672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383441.996040:0:14820:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1787383441.996052:0:14820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1787383442.000221:0:14821:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787383442.000245:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873472 00000100:00100000:3.0:1787383442.000254:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873472 00000100:00100000:3.0:1787383442.000516:0:14821:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787383442.000523:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873600 00000100:00100000:3.0:1787383442.000526:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873600 00000100:00100000:3.0:1787383442.000545:0:14821:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787383442.000550:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873856 00000100:00100000:3.0:1787383442.000553:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873856 00000100:00100000:3.0:1787383442.000566:0:14821:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787383442.000572:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873728 00000100:00100000:3.0:1787383442.000574:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873728 00000100:00100000:2.0:1787383442.002521:0:16319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1787383442.002542:0:16319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:2349:x1874206962873344:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:2.0:1787383442.002594:0:16319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.002613:0:16319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383442.002617:0:16319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383442.002624:0:16319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.002637:0:16319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383442.112602:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1787383442.112625:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1787383442.113177:0:14819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787383442.113183:0:14819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787383441 -> 1787383442 00002000:00010000:1.0:1787383442.113186:0:14819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787383441 -> 1787383442 00002000:00010000:1.0:1787383442.113189:0:14819:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1787383442.113204:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113219:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113227:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113234:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383442.113252:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113261:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113282:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113290:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5913e85/0x42020b050d5d013f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383442.113393:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+21:2348:x1874206962872960:12345-192.168.202.19@tcp:4:dd.0 Request processed in 150364us (150711us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787383442.113403:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1787383442.113434:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1787383442.113444:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+20:2348:x1874206962873472:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:1.0:1787383442.113475:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113486:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383442.113490:0:14819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383442.113496:0:14819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.113506:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383442.155265:0:16319:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1787383442.155277:0:16319:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:0.0:1787383442.155293:0:16319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155307:0:16319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155317:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155338:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc3519d800 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383442.155344:0:16319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155353:0:16319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155376:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155398:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5b44812/0x42020b050d5d0154 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383442.155488:0:16319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7402715-e6da-4c59-9e36-8e96e26e21ad+22:2349:x1874206962873344:12345-192.168.202.19@tcp:4:dd.0 Request processed in 152948us (173354us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787383442.155498:0:16319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1787383442.155528:0:16319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1787383442.155541:0:16319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7402715-e6da-4c59-9e36-8e96e26e21ad+21:2348:x1874206962873600:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:0.0:1787383442.155573:0:16319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155585:0:16319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.155589:0:16319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.155596:0:16319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.155607:0:16319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383442.155755:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:0.0:1787383442.156637:0:16317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156652:0:16317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156675:0:16317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156682:0:16317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc34e98600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383442.156686:0:16317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156695:0:16317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156710:0:16317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156717:0:16317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c403482f/0x42020b050d5d0146 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383442.156778:0:16317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:2348:x1874206962873088:12345-192.168.202.19@tcp:4:dd.0 Request processed in 176324us (182154us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787383442.156787:0:16317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1787383442.156814:0:16317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1787383442.156824:0:16317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:2349:x1874206962873856:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:0.0:1787383442.156862:0:16317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156903:0:16317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.156914:0:16317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.156919:0:16317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.156931:0:16317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157199:0:16318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157210:0:16318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157217:0:16318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157222:0:16318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aac400 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383442.157226:0:16318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157232:0:16318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157243:0:16318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157251:0:16318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d08029bb/0x42020b050d5d014d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383442.157300:0:16318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7402715-e6da-4c59-9e36-8e96e26e21ad+14:2349:x1874206962873216:12345-192.168.202.19@tcp:4:dd.0 Request processed in 170795us (175355us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787383442.157308:0:16318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1787383442.157337:0:16318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1787383442.157346:0:16318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7402715-e6da-4c59-9e36-8e96e26e21ad+13:2349:x1874206962873728:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:0.0:1787383442.157364:0:16318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157373:0:16318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.157377:0:16318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383442.157381:0:16318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.157391:0:16318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383442.209747:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1787383442.213571:0:14819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1787383442.213585:0:14819:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:2.0:1787383442.213603:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213617:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213626:0:14819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213633:0:14819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffb01aade00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:2.0:1787383442.213637:0:14819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213661:0:14819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213684:0:14819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383442.213692:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014bab189/0x42020b050d5d015b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383442.213784:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7402715-e6da-4c59-9e36-8e96e26e21ad+17:2348:x1874206962873472:12345-192.168.202.19@tcp:4:dd.0 Request processed in 100337us (218359us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787383442.213796:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00010000:00010000:1.0:1787383442.245566:0:16318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245589:0:16318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245599:0:16318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245608:0:16318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046c00 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:1.0:1787383442.245613:0:16318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245624:0:16318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245650:0:16318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383442.245659:0:16318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d12abc7/0x42020b050d5d0170 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383442.245765:0:16318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7402715-e6da-4c59-9e36-8e96e26e21ad+15:2349:x1874206962873728:12345-192.168.202.19@tcp:4:dd.0 Request processed in 88413us (250086us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787383442.245776:0:16318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000001:00080000:1.0:1787383442.245985:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:1.0:1787383442.246003:0:6624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1787383442.248314:0:16317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248344:0:16317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248354:0:16317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248383:0:16317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17046000 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383442.248390:0:16317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248400:0:16317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248419:0:16317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.248427:0:16317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d937f19/0x42020b050d5d0169 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383442.248501:0:16317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+7:2349:x1874206962873856:12345-192.168.202.19@tcp:4:dd.0 Request processed in 91676us (252857us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787383442.248512:0:16317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00010000:00010000:0.0:1787383442.250142:0:16319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250159:0:16319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250168:0:16319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250193:0:16319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffc17047600 already unused, calling callback (ffffffffc16dde90) 00010000:00010000:0.0:1787383442.250198:0:16319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250207:0:16319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250224:0:16319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383442.250231:0:16319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071f78826/0x42020b050d5d0162 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383442.250320:0:16319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2348:x1874206962873600:12345-192.168.202.19@tcp:4:dd.0 Request processed in 94782us (254709us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787383442.250339:0:16319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:3.0:1787383442.954295:0:14169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383443.441788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.441830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.441851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.441912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.441938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.441963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.442005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1787383443.442033:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874368 00000100:00100000:2.0:1787383443.442044:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874368 00000100:00100000:2.0:1787383443.442102:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874624 00000100:00100000:2.0:1787383443.442106:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874624 00000100:00100000:2.0:1787383443.442125:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874240 00000100:00100000:2.0:1787383443.442128:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874240 00000100:00100000:2.0:1787383443.442144:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874752 00000100:00100000:2.0:1787383443.442147:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874752 00000100:00100000:2.0:1787383443.442176:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383443.442187:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2349:x1874206962874368:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.442622:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2349:x1874206962874368:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 435us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.442632:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1787383443.442656:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1787383443.442664:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7685e87c-077f-4994-b884-062063d6ea60+5:2349:x1874206962874624:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.442694:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7685e87c-077f-4994-b884-062063d6ea60+5:2349:x1874206962874624:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 32us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.442700:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1787383443.442712:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383443.442718:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2349:x1874206962874240:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.442744:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7402715-e6da-4c59-9e36-8e96e26e21ad+5:2349:x1874206962874240:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.442750:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1787383443.442762:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383443.442768:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7685e87c-077f-4994-b884-062063d6ea60+5:2349:x1874206962874752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.442790:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7685e87c-077f-4994-b884-062063d6ea60+5:2349:x1874206962874752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.442796:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1787383443.442821:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962873984 00000100:00100000:2.0:1787383443.442825:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962873984 00000100:00100000:2.0:1787383443.442854:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1787383443.442861:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:2349:x1874206962873984:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.442912:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1015050f-5d12-4451-a0c1-63e34e492629+13:2349:x1874206962873984:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 52us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.442917:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1787383443.442949:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874112 00000100:00100000:2.0:1787383443.442952:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874112 00000100:00100000:2.0:1787383443.443036:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206962874496 00000100:00100000:2.0:1787383443.443040:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206962874496 00000100:00100000:2.0:1787383443.443060:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1787383443.443067:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+20:2349:x1874206962874112:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.443099:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7402715-e6da-4c59-9e36-8e96e26e21ad+20:2349:x1874206962874112:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.443107:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1787383443.443120:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1787383443.443126:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:2349:x1874206962874496:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1787383443.443154:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7685e87c-077f-4994-b884-062063d6ea60+6:2349:x1874206962874496:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383443.443160:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00080000:2.0:1787383443.443179:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383443.443186:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383443.443189:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787383443.980073:0:15538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383444.070811:0:16356:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787383445.002160:0:14168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383445.258223:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979631616:0@lo:400:kworker.0 00000100:00100000:2.0:1787383445.258326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383445.258404:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383445.258413:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979631744:0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.258432:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631616 00000100:00100000:2.0:1787383445.258447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383445.258449:0:15532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631616 00000100:00100000:2.0:1787383445.258523:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631744 00000100:00100000:2.0:1787383445.258531:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631744 00000100:00100000:3.0:1787383445.258539:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383445.258555:0:15532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979631616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383445.258588:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383445.258601:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc2d21e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383445.258694:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb4211d2-6362-43cb-a936-032e5733e3e9:3314:1874206979631360:0@lo:400:kworker.0 00000100:00100000:1.0:1787383445.259253:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979631488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383445.259343:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874206979631744:12345-0@lo:400:kworker.0 Request processed in 744us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383445.259353:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787383445.259394:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383445.259449:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874206979631744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383445.259464:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979631616:0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.261901:0:15532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc2d21df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979631616:12345-0@lo:400:kworker.0 Request processed in 3339us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.261918:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383445.265786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383445.265920:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979631872:0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.265935:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631360 00000100:00100000:3.0:1787383445.265955:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631360 00000100:00100000:0.0:1787383445.265994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383445.266044:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787383445.266060:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc0ce40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3314:x1874206979631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383445.266086:0:14181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631872 00000100:00100000:0.0:1787383445.266095:0:14181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631872 00000100:00100000:0.0:1787383445.266166:0:14181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383445.266181:0:14181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979631872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.266195:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc0ce40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb4211d2-6362-43cb-a936-032e5733e3e9+19:3314:x1874206979631360:12345-0@lo:400:kworker.0 Request processed in 130us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.266205:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787383445.266276:0:14181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3ce1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874206979631872:12345-0@lo:400:kworker.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383445.266284:0:14181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787383445.266324:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383445.266367:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb4211d2-6362-43cb-a936-032e5733e3e9:3314:1874206979631360:0@lo:400:kworker.0 00000100:00100000:0.0:1787383445.266385:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1874206979631872:0@lo:400:kworker.0 00000100:00100000:1.0:1787383445.266595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383445.266632:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc2d21ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979632000:0@lo:400:kworker.0 00000100:00100000:1.0:1787383445.266664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383445.266674:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979631488 00000100:00100000:3.0:1787383445.266682:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979631488 00000100:00100000:3.0:1787383445.266739:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383445.266754:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979631488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.266829:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874206979631488:12345-0@lo:400:kworker.0 Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.266837:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383445.266997:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383445.266999:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979632000 00000100:00100000:3.0:1787383445.267009:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979632000 00000100:00100000:3.0:1787383445.267049:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383445.267056:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979632000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.267092:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874206979632000:12345-0@lo:400:kworker.0 Request processed in 37us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.267098:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383445.267261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383445.267305:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383445.267313:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc3cb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383445.267328:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979632128 00000100:00100000:3.0:1787383445.267336:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979632128 00000100:00100000:1.0:1787383445.267352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383445.267561:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383445.267567:0:14176:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383445.267730:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787383445.267736:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffc3c851f80, transno 8589934595 00000004:00080000:1.0:1787383445.267756:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787383445.267779:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1874206979631488:0@lo:400:kworker.0 00000100:00100000:1.0:1787383445.267794:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc2d21ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1874206979632000:0@lo:400:kworker.0 00000100:00100000:3.0:1787383445.268821:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206979632256 00000100:00100000:3.0:1787383445.268834:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206979632256 00000100:00100000:3.0:1787383445.268895:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383445.268906:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979632128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383445.268947:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787383445.269054:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979632128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.269061:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383445.269078:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787383445.269084:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc3cb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979632256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383445.269102:0:14818:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1787383445.269128:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc3cb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874206979632256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383445.269134:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383445.273289:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979632256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383445.273333:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ffc3cb5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1874206979632128:0@lo:13:osp-pre-0-0.0 Debug log: 29486 lines, 29486 kept, 0 dropped, 0 bad.